1. 09 Aug, 2017 1 commit
    • Victor Kotlyar's avatar
      Make archive reporting on the flush for the batch of jobs. · c8827ade
      Victor Kotlyar authored
      Changed reporting to the Catalog with a batch of written files.
      Changed synchronous reporting to the backend job by job to the
      asynchronous reporting for batch of jobs.
      Changed synchronous reporting to the EOS mgm to the asynchronous
      reporting.
      c8827ade
  2. 02 Aug, 2017 1 commit
    • Eric Cano's avatar
      Added logging to archive jobs requeueing. · aedb3156
      Eric Cano authored
      Log added to ArchiveJob::~ArchiveJob() and ArchiveRequest::garbageCollect().
      Removed deprecated functions from previous archive directory model (pre-catalogue).
      aedb3156
  3. 27 Jul, 2017 1 commit
    • Eric Cano's avatar
      Implemented missing OStoreDB::RetrieveJob::fail() · 3a824734
      Eric Cano authored
      The retrieve request now gets properly queued in case of retrieve error.
      The errors are counted and the request gets deleted eventually.
      A new field was added to the retrive request in object store. This commit
      will fail on upgrade if there are retrieve requests still queued at update time.
      Cleaned up some unused structures in cta.proto
      Minor modifications to ArchiveJobs.
      3a824734
  4. 18 Jul, 2017 1 commit
    • Eric Cano's avatar
      Created a helper function for retrieve queue selection. · be6d0b4d
      Eric Cano authored
      In order to be efficient, the data (tape status and queue sizes) is cached in memory.
      This function needed access to the catalogue (where the tape status is located).
      This in turn required passing the catalogue object to:
       - The garbage colletion functions for all object types.
       - The garbage collector object now keeps a reference to the catalogue.
       - The path to the catalogue credential file should now be passed to cta-objectstore-collect-orphaned-object
       - The OStoreDB also needs a reference to the catalogue in order to queue retrive requests.
      
       The garbage collection member function are now also being passed a log context, so the requirement for better
       log of object fate can also be fulfilled later. This in turn required the passing of a logger object to
       the object store and relative helper classes.
      
       Finally, a dummy catalogue class has been created to be used in unit tests.
      be6d0b4d
  5. 20 Jun, 2017 2 commits
  6. 19 Jun, 2017 1 commit
  7. 09 May, 2017 1 commit
  8. 03 May, 2017 1 commit
  9. 12 Apr, 2017 1 commit
  10. 09 Feb, 2017 1 commit
    • Eric Cano's avatar
      #62: created in memory archive request queues · f33b4819
      Eric Cano authored
      Those queues will hold in memory the addition of the archive requests from several threads
      and them all in one go, in order to limit contention and round trips on the object store.
      f33b4819
  11. 22 Nov, 2016 1 commit
  12. 16 Nov, 2016 1 commit
  13. 08 Jul, 2016 1 commit
  14. 07 Jul, 2016 1 commit
  15. 30 Jun, 2016 1 commit
  16. 23 Jun, 2016 1 commit
  17. 06 Jun, 2016 1 commit
    • Eric Cano's avatar
      Fixed uninitialized values after extending policy structure. · 0aa2d510
      Eric Cano authored
      The values are now hardcoded.
      Cleanup:
        - Removed object store unit tests for data now in the catalogue.
        - Removed now unnecessary 2nd step addition of retry limits to archive jobs.
        - Removed deprecated ArchiveToFileRequest files.
      0aa2d510
  18. 25 May, 2016 1 commit
    • Eric Cano's avatar
      Started morphing the code to accomodate both the move some data structure from... · 7724a676
      Eric Cano authored
      Started morphing the code to accomodate both the move some data structure from OStoreDB to catalogue and shared structures modifications.
      Renamed class members using underscode instead of mixed case.
      Removed mount criteria from in-memory tape pool representation.
      Removed support for path of archive files for in-memory representations.
      Removed all but maxDrives allowed from in-memory representation of mount
      policy.
      Created new constructor for UserIdentity.
      Switch the UserIdentity used by RemoteFileStatus.
      Renamed TapePoolQueue to ArchiveQueue.
      Replaced CreationLog usages with EntryLog.
      Renamed TapeQueue to RetrieveQueue.
      Removed support for data now gone to catalogue from RootEntry.
      Removed corresponding structures from object store.
      Removed corresponding calls from SchedulerDatabase and inheriting
      classes (OStoreDB).
      7724a676
  19. 12 Apr, 2016 1 commit
  20. 04 Apr, 2016 1 commit
  21. 07 Mar, 2016 1 commit
  22. 04 Mar, 2016 1 commit
  23. 01 Mar, 2016 1 commit
  24. 29 Feb, 2016 2 commits
  25. 26 Feb, 2016 2 commits