- Jan 25, 2019
-
-
Michael Davis authored
-
- Oct 29, 2018
-
-
Steven Murray authored
-
- Sep 27, 2018
-
-
Eric Cano authored
-
- Sep 20, 2018
-
-
Michael Davis authored
Because ToReport queues need to construct RetrieveJob objects which are not associated with a mount
-
- Sep 14, 2018
-
-
Michael Davis authored
-
- Aug 30, 2018
-
-
Eric Cano authored
The maintenance process replaces the garbage collector process. It now runs both garbage collection and disk reports.
-
Eric Cano authored
-
Eric Cano authored
-
Eric Cano authored
Changed the lifecycle of the ArchiveRequest to handle the various combinations of several jobs and their respective success/failures. Most notably, the request now holds a reportdecided boolan, which is set when decing to report. This happens when failing to archive one copy (first failure), or when all copies are transferred (success for all copies). Added support for in-mount retries. On falure, the job will be requeued (with a chance to pick it up again) in the same session if sane session retries are not exceeded. Otherwise, the job is left owned by the session, to be picked up by the garbage collector at tape unmount. Made disk reporter generic, dealing with both success and failure. Improved mount policy support fir queueing. Expanded information avaible in popped element from archive queues. Added optional parameters to ArchiveRequest::asyncUpdateJobOwner() to cover various cases. Updated the archive job statuses. Clarified naming of functions (transfer/report failure instead of bare \"failure\"). Updated garbage collector for new archive job statuses. Added support for report retries and batch reporting in the scheduler database. Updated obsolete wording in MigrationReportPacker log messages and error counts.
-
Eric Cano authored
This class will handle reporting like the GarbageCollector class does for garbage collection. Adapted the interface of scheduler and ArchiveRequests to allow delegating reporting to the disk report runner. This commit is not functionnal. We still need to: - Implement the ToReport/Failed queues interface. - Adapt the queueing in the scheduler/ArchiveMount - Implement the popping of jobs to report. - Implement the async reporter for the files. - Develop the user interface for failed requests.
-
- Aug 14, 2018
-
-
Eric Cano authored
The tape write task not lister anymore to the memory manager for zero length files.
-
Eric Cano authored
A retry might sneak into the session (depending of end of sessions and reporting speeds). Relaxed the test criteria for this case.
-
Eric Cano authored
We now leave a placeholder on the tape and carry on in this case. The errors will eventually clear the archive request.
-
Eric Cano authored
The disk read task hangs in this case. The tape write taks is still created, will leave a placeholder on the tape (to be implemented) and count an error for the request.
-
- Aug 13, 2018
-
-
Michael Davis authored
-
- Aug 01, 2018
-
-
Steven Murray authored
cta/CTA#296 Temporary disabled unit-test OStoreDBPlusMockSchedulerTestVFS/DataTransferSessionTest.DataTransferSessionMissingFilesMigration/0
-
- Jul 31, 2018
-
-
Steven Murray authored
-
- Jul 30, 2018
-
-
Steven Murray authored
Modified CMakeLists.txt files to apply -Wno-unused-function for GCC 6 and above. It was GCC 7 and above before.
-
- Jul 05, 2018
-
-
Eric Cano authored
This setup allows reproducing a but seen in system tests.
- Jul 04, 2018
-
-
Eric Cano authored
This is validated in a unit test.
-
Eric Cano authored
The catalogue can receive polymorphic items as input for recording. The strict sequencing of fSeqs is still enforced. Currently, 2 items types are recorded: files and placehoders. Files are recorded to the tape catalogue, while place holders are not, but they are used to enforce the fSeq sequencing.
-
Eric Cano authored
When no data is received for a given file, the tape server will leave a placeholder on tape an carry on with the writing of the following files, avoiding a tape unmount. Updated unit test.
-
- Jun 29, 2018
-
-
Eric Cano authored
-
- Jun 28, 2018
-
-
Eric Cano authored
-
- Jun 06, 2018
-
-
Eric Cano authored
This should ease the contention on the object store.
-
- May 29, 2018
-
-
Eric Cano authored
The error(s) gets recorded at failure time, and the list is printed at job deletion time.
-
- May 15, 2018
-
-
Eric Cano authored
-
- May 14, 2018
-
-
Eric Cano authored
This version is not data safe as the request is created late, right after referencing the job to the queue.
-
- May 11, 2018
-
-
Eric Cano authored
The top half goes as far as when the request is safe in the object store. At that point, the bottom half is launched in a new thread, and success is returned the called. This will enable lower latency for the users while retaining the same data safety. This version is experimental aas it spans an undetermined number of threads. A more controlled version with a work queue should be implenented on the long run.
-
- May 03, 2018
-
- Apr 30, 2018
- Apr 27, 2018
-
-
Julien Leduc authored
-
- Apr 09, 2018
-
-
Anastasia Karachaliou authored
-
Steven Murray authored
Moved SourcedParameter<FetchReportOrFlushLimits>::set() from SourcedParameter.cpp to TapedConfiguration.cpp SourcedParameter.cpp is the "common" CTA directory, in other words CTA/commIit is located at on/SourcedParameter.cpp. The SourceParameter.cpp file should therefore not contain any code specific to a particular CTA daemon such as cta-taped.
-
Steven Murray authored
Moved SourcedParameter<FetchReportOrFlushLimits>::addLogParamForValue() from SourcedParameter.cpp to TapedConfiguration.cpp SourcedParameter.cpp is the "common" CTA directory, in other words CTA/commIit is located at on/SourcedParameter.cpp. The SourceParameter.cpp file should therefore not contain any code specific to a particular CTA daemon such as cta-taped.
-
Steven Murray authored
Moved SourcedParameter<TpconfigLine>::addLogParamForValue() from SourcedParameter.cpp to TapedConfiguration.cpp SourcedParameter.cpp is the "common" CTA directory, in other words CTA/commIit is located at on/SourcedParameter.cpp. The SourceParameter.cpp file should therefore not contain any code specific to a particular CTA daemon such as cta-taped.
-
- Mar 23, 2018
-
-
Eric Cano authored
The jobs will now remain attached to the agent of the drive process. The garbage collector process will now requeue them instead of drive process. This will allow the drive process to restart faster for a new session and the drive process to requeue the jobs faster a it processes jobs in bulk.
-
Eric Cano authored
-