1. 22 Jan, 2019 1 commit
  2. 10 Dec, 2018 1 commit
    • Eric Cano's avatar
      Implemented promotion of repack requests from Pending to ToExpand · bc52524e
      Eric Cano authored
      This promotion is controlled so that only a limited number a requests
      are in the
      state ToExpand or Starting at any point in time. This ensures both the
      availabality
      of repack file requests to system while preventing an explosion of file
      level requests.
      
      Created a one-round popping from the container (algorithms) with status
      switching.
        - Used for repack requests switching from pendig to to expand
      
      Added ElementStatus to algorithms.
      
      Implemented promotion interface in Scheduler and OstoreDb. The actual
      decision is taken at
      the Scheduler level. The function itself is called by the
      RepackRequestManager.
      
      Promotion is tested in a unit test.
      
      Various code maintenance:
      Switched to "using"-based constructor inheritance.
      Fixed privacy of function in cta::range.
      bc52524e
  3. 01 Oct, 2018 2 commits
  4. 10 Sep, 2018 3 commits
  5. 05 Sep, 2018 1 commit
  6. 30 Aug, 2018 1 commit
    • Eric Cano's avatar
      Generalized queue type to "ToTransfer" "ToReport" "Failed". · 98281aa6
      Eric Cano authored
      "ToTransfer" are to be picked up by tape sessions.
      "ToReport" Includes both successes and failures to report, as the mechanism to report is the same.
         They will be handled by the reporter, which shares the single thread of the garbage collector.
      "Failed" Will be a (possibly non-queue) container which will contain the failed requests. The operators
         will be able to examine, relaunch or abandon those requests.
      
      The states and lifecycles of the requests have been reworked to reflect this lifecycle too.
      The container algorithmes have been adapted to handle the multiple queue/container types.
      98281aa6
  7. 10 Aug, 2018 1 commit
  8. 23 Jul, 2018 1 commit
  9. 26 Jun, 2018 1 commit
  10. 20 Jun, 2018 1 commit
  11. 06 Feb, 2018 1 commit
  12. 19 Jan, 2018 1 commit
  13. 19 Dec, 2017 1 commit
  14. 26 Oct, 2017 1 commit
  15. 03 Oct, 2017 1 commit
  16. 25 Sep, 2017 1 commit
  17. 15 Aug, 2017 1 commit
  18. 18 Jul, 2017 1 commit
    • Eric Cano's avatar
      Created a helper function for retrieve queue selection. · be6d0b4d
      Eric Cano authored
      In order to be efficient, the data (tape status and queue sizes) is cached in memory.
      This function needed access to the catalogue (where the tape status is located).
      This in turn required passing the catalogue object to:
       - The garbage colletion functions for all object types.
       - The garbage collector object now keeps a reference to the catalogue.
       - The path to the catalogue credential file should now be passed to cta-objectstore-collect-orphaned-object
       - The OStoreDB also needs a reference to the catalogue in order to queue retrive requests.
      
       The garbage collection member function are now also being passed a log context, so the requirement for better
       log of object fate can also be fulfilled later. This in turn required the passing of a logger object to
       the object store and relative helper classes.
      
       Finally, a dummy catalogue class has been created to be used in unit tests.
      be6d0b4d
  19. 29 Jun, 2017 2 commits
  20. 28 Jun, 2017 1 commit
  21. 20 Jun, 2017 3 commits
  22. 19 Jun, 2017 1 commit
  23. 12 Apr, 2017 1 commit
    • Eric Cano's avatar
      cta/CTA#46: Garbage collection improvements · e446e939
      Eric Cano authored
      Implemented Agent::garbageCollect()
      Made AgentWatchdog fetch the timout from the agent object.
      Fixed unconditional time tounter reset in AgentWatchdog::checkAlive()
      Fixed missing log for garbageCollection.
      Added utility (cta-objectstore-unfollow-agent) to mark agents as not followed when they get orphaned. This utility detects looping ownerships (two garbage coolectors watch each other and both die synchronously). This utility is not packaged.
      Various log improvements.
      e446e939
  24. 03 Apr, 2017 1 commit
    • Eric Cano's avatar
      cta/CTA#46: Adding garbage collection for object store structures: · cfe8f58b
      Eric Cano authored
      Created a garbage collector subprocess for the drive daemon.
      Created a AgentHeartbeat thread and added it to frontend, drive subprocess and GC subprocess.
      Fixed logs and drive subprocess.
      Renamed common/threading/Threading.[hc]pp to Thread.[hc]pp as there is only one class left in this file.
      cfe8f58b
  25. 16 Jan, 2017 1 commit
  26. 16 Nov, 2016 1 commit
  27. 26 Oct, 2016 1 commit
  28. 15 Aug, 2016 1 commit
    • Eric Cano's avatar
      Split the Agent class into AgentReference and Agent. · 390ccab7
      Eric Cano authored
      Agent becomes a usual class, like any other in the object store.
      Object name generation (agent's and others) is now handled in the separate AgentReference.
      The previous situation created race conditions.
      390ccab7
  29. 22 Jun, 2016 1 commit
  30. 06 Jun, 2016 1 commit
    • Eric Cano's avatar
      Fixed uninitialized values after extending policy structure. · 0aa2d510
      Eric Cano authored
      The values are now hardcoded.
      Cleanup:
        - Removed object store unit tests for data now in the catalogue.
        - Removed now unnecessary 2nd step addition of retry limits to archive jobs.
        - Removed deprecated ArchiveToFileRequest files.
      0aa2d510
  31. 31 May, 2016 1 commit
    • Eric Cano's avatar
      Added support for getting queued archive requests. · 028d9ea1
      Eric Cano authored
      Added binned running counters (ValueCoundMap) for managing summaries of priorities in object store queues.
      Simplified the interfaces to the getPendingArchiveJobs and getPendingRetrieveJobs functions in Scheduler and SchedulerDB.
      Removed now unused ArchiveToTapeCopyRequest.
      Removed long unused mockScheduler.
      Removed _old_protoype files.
      028d9ea1
  32. 25 May, 2016 1 commit
    • Eric Cano's avatar
      Started morphing the code to accomodate both the move some data structure from... · 7724a676
      Eric Cano authored
      Started morphing the code to accomodate both the move some data structure from OStoreDB to catalogue and shared structures modifications.
      Renamed class members using underscode instead of mixed case.
      Removed mount criteria from in-memory tape pool representation.
      Removed support for path of archive files for in-memory representations.
      Removed all but maxDrives allowed from in-memory representation of mount
      policy.
      Created new constructor for UserIdentity.
      Switch the UserIdentity used by RemoteFileStatus.
      Renamed TapePoolQueue to ArchiveQueue.
      Replaced CreationLog usages with EntryLog.
      Renamed TapeQueue to RetrieveQueue.
      Removed support for data now gone to catalogue from RootEntry.
      Removed corresponding structures from object store.
      Removed corresponding calls from SchedulerDatabase and inheriting
      classes (OStoreDB).
      7724a676
  33. 04 Apr, 2016 1 commit
  34. 15 Mar, 2016 1 commit