Uploaded image for project: 'Grouper'
  1. Grouper
  2. GRP-2320

ability to limit daemon jobs by host/process

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Unresolved
    • Minor
    • None
    • 2.3.0
    • daemon
    • None

    Description

      Because some jobs ( CLC, OtherJob, PSPNG, etc...) need more RAM/CPU it would be helpful to be able to partition jobs into "sets" and have some daemon instance only process jobs from some of those sets.

      Being able to control this can be a cost savings to deployments. ( Especially if they are a cloud based deployment where RAM and CPU equates directly to money. Spent.)

       

      Example. If there  are one (or more) large loader job that takes 3 GB of ram to cache/load data into memory then those jobs require the "high water mark" of Ram and could be identified as a set. (let's call that set "large") However, it is also possible that there are lots of other tasks/jobs that only require "1 GB" of ram.  (let's call that set "normal") The "normal" jobs could be run on on more daemon's with smaller hardware size/scale OR on the "large" daemon loaders too. However, if the "Large" job is run on a "small" daemon then it would fail with not enough RAM, or end up swapping to disk and performing very badly at best.

      Attachments

        Activity

          People

            chris.hyzer@at.internet2.edu Chris Hyzer (upenn.edu)
            carey.black@at.internet2.edu Carey Black (osu.edu)
            Votes:
            2 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: