1. 13 Dec, 2018 1 commit
  2. 29 May, 2018 1 commit
    • Eric Cano's avatar
      Added new queue sets in RootEntry. · e21dd9f8
      Eric Cano authored
      We now have live (to be executed), failed and to be reported queues.
      Archive jobs have all three types, retrieve jobs do not have a to be reported
      queue. The RootEntry interface interface now provides the choice between the types.
      All uses are currently hardcoded to LiveJobs.
      e21dd9f8
  3. 19 Jan, 2018 1 commit
  4. 20 Dec, 2017 2 commits
  5. 17 Aug, 2017 1 commit
  6. 16 Aug, 2017 1 commit
  7. 03 Aug, 2017 2 commits
  8. 28 Jul, 2017 1 commit
  9. 27 Jul, 2017 4 commits
  10. 25 Jul, 2017 1 commit
  11. 21 Jul, 2017 2 commits
  12. 20 Jul, 2017 1 commit
  13. 05 Jul, 2017 1 commit
    • Eric Cano's avatar
      Fixed queuing strategy in MemArchiveQueue::sharedAddToArchiveQueue(). · 111a58d5
      Eric Cano authored
      We now only do one queue update at a time (per process). While one batch is being pushed to the objet store, the
      following one is being built up, and written as soon as the previous write completes. This can be see in the timings from
      the logs of the unit test OStoreSchedulerDatabaseTestVFS/SchedulerDatabaseTest.createManyArchiveJobs/0 here:
      [...] MSG="In MemArchiveQueue::sharedAddToArchiveQueue(): added batch of jobs to the queue." objectQueue="archiveQueue-[...]-68" sizeBefore="0" sizeAfter="1" addedJobs="1" waitTime="0.002403" enqueueTime="0.036594"
      [...] MSG="In MemArchiveQueue::sharedAddToArchiveQueue(): added batch of jobs to the queue." objectQueue="archiveQueue-[...]-68" sizeBefore="1" sizeAfter="100" addedJobs="99" waitTime="0.036547" enqueueTime="0.001629"
      [...] MSG="In MemArchiveQueue::sharedAddToArchiveQueue(): added batch of jobs to the queue." objectQueue="archiveQueue-[...]-174" sizeBefore="0" sizeAfter="1" addedJobs="1" waitTime="0.000058" enqueueTime="0.061447"
      [...] MSG="In MemArchiveQueue::sharedAddToArchiveQueue(): added batch of jobs to the queue." objectQueue="archiveQueue-[...]-174" sizeBefore="1" sizeAfter="198" addedJobs="197" waitTime="0.061434" enqueueTime="0.001431"
      [...] MSG="In MemArchiveQueue::sharedAddToArchiveQueue(): added batch of jobs to the queue." objectQueue="archiveQueue-[...]-174" sizeBefore="198" sizeAfter="200" addedJobs="2" waitTime="0.000840" enqueueTime="0.037259"
      111a58d5
  14. 29 May, 2017 1 commit
  15. 19 May, 2017 1 commit
    • Eric Cano's avatar
      Reviewed promised based thread synchronisation · 8012a02d
      Eric Cano authored
      Fixed calls to promise::get_future() after possible access form other thread. They are now guaranteed to happen before.
      Added helgrind annotations for promise based synchronisation.
      Added macros enabling helgrind annotations for shared_ptr.
      Added suppression for shared_ptr used inside other standard lib object and not covered by the previous macros.
      Added unit test for lower level .
      Added suppressions for reported race conditions in Rados library.
      Review heavily MemArchiveQueue and fixed missing commit in object store, leading to potentially orphaned objects.
      Enabled formerly disabled test as it is now fast enough.
      8012a02d
  16. 17 May, 2017 1 commit
  17. 16 Feb, 2017 1 commit
  18. 15 Feb, 2017 2 commits
  19. 09 Feb, 2017 1 commit
    • Eric Cano's avatar
      #62: created in memory archive request queues · f33b4819
      Eric Cano authored
      Those queues will hold in memory the addition of the archive requests from several threads
      and them all in one go, in order to limit contention and round trips on the object store.
      f33b4819