ReleaseNotes.md 21.8 KB
Newer Older
1
2
3
4
5
6
7
# v4.NEXT

## Summary

## Upgrade Instructions

## Features
mvelosob's avatar
mvelosob committed
8
9
- cta/CTA#1054 - Fix filing of disk buffer when recalling from tapeservers with RAO
- cta/CTA#1076 - Retrieve fails if disk system configuration is removed
10
- cta/CTA#1087 - Add new tapeserver config option UseEncryption
mvelosob's avatar
mvelosob committed
11
- cta/CTA#1096 - Better handling of bad checksums in archive/retrieve sessions
12
13

## Bug fixes
14
- cta/CTA#1092 - Fix overflow error with drive state latestBandwith causing cta frontend crash
15
- cta/CTA#501 - Fix disappearing reason when TapeDrive is reading or writing
16

mvelosob's avatar
mvelosob committed
17
18
19
20
21
22
23
24
25
# v4.4.1-1

## Upgrade Instructions

## Features

## Bug fixes
- cta/CTA#1092 Fix overflow with drive bandwith causing frontend to crash

26
# v4.4.0-1
27

28
## Upgrade Instructions
29

30
31
32
This CTA release requires a database schema upgrade to CTA catalogue schema v4.3. Please consult the [database upgrade documentation](https://tapeoperations.docs.cern.ch/ctaops/upgrade_production_database).

## Features
33
34
- Upgraded EOS to 4.8.67 in CI versionlock.list file
  - EOS/EOS-4976 Fix activity field passed from EOS to CTA
mvelosob's avatar
mvelosob committed
35
36
- cta/CTA#607 - Add client host and username in cta-frontend logs
- cta/CTA#777 - Minimize mounts for dual copy tape pool recalls
37
- cta/CTA#928 - Add youngest request age to cta-admin sq
mvelosob's avatar
mvelosob committed
38
- cta/CTA#1020 - cta-restore-deleted-files command for restoring deleted files
Jorge Camarero Vera's avatar
Jorge Camarero Vera committed
39
- cta/CTA#1026 - Add activity Mount Policy resolution to CTA
40
- cta/CTA#1057 - Remove support for MySQL
Jorge Camarero Vera's avatar
Jorge Camarero Vera committed
41
42
- cta/CTA#1069 - Open BackendVFS ObjectStore files in R/W mode when obtaining exclusive locks
- cta/CTA#1070 - Update eos to version 4.8.67
43
- cta/CTA#1074 - Improve error reporting when retrieving archive
Jorge Camarero Vera's avatar
Jorge Camarero Vera committed
44
45
- cta/CTA#1077 - Remove activity fair scheduling logic
- cta/CTA#1083 - Upgrade ceph to version 15.2.15
Jorge Camarero Vera's avatar
Jorge Camarero Vera committed
46
- cta/CTA#1068 - Build cta with gcc 7.x(C++17) and fix deprecated code
47

48
## Bug fixes
49
- cta/CTA#1059 - Clean up warnings reported by static analysis
mvelosob's avatar
mvelosob committed
50
- cta/CTA#1062 - cta-admin tf rm should store the diskFilePath when deleting the tape file copy
Volodymyr Yurchenko's avatar
Volodymyr Yurchenko committed
51
- cta/CTA#1073 - Retry failed reporting for archive jobs
52
- cta/CTA#1078 - fix STALE message when cta-taped is restarting
53
- cta/CTA#1081 - refactor database queries for drive ls
54

Jorge Camarero Vera's avatar
Jorge Camarero Vera committed
55
# v4.3-3
56
57
58
59
60

## Summary

### Features
- cta/CTA#1053 Remove the objectstore presence in another classes
Jorge Camarero Vera's avatar
Jorge Camarero Vera committed
61
- cta/CTA#501 cta-taped should set the state to DOWN when machine rebooting
62
63

### Bug fixes
64
- cta/CTA#1056 Fix bugs in cta 4.3-2
Jorge Camarero Vera's avatar
Jorge Camarero Vera committed
65
- cta/CTA#1058 Remove helgrind_annotator from production
66

67
# v4.3-2
68
69
70

## Summary

71
### Features
mvelosob's avatar
mvelosob committed
72
- cta-admin: All short options with more than one character now require two dashes
73
74
75

### Bug fixes
- cta/CTA#1013 reportType uninitialized
76
- cta/CTA#1044 Fix segmentation fault due to uninitialized optional value and remove diskSpaceReservations from `cta-admin dr ls`
77
78
79
80
81

# v4.3-1

## Summary

82
### Features
83
84
- cta/CTA#976 Add logical part of Drive Status using Catalogue
- cta/CTA#988 Add diskSpaceReservations map in cta-admin --json dr ls output.
85
86
87
- cta/CTA#983
  - Add cta-versionlock helper script to cta-release package
  - Update cta repo file to use the new public repo
88
89
- cta/CTA#1036 Better error reporting in cta-admin tools
- cta/CTA#1039 Improve logging of cta admin commands in cta frontend
90
- cta/CTA#1041 Fix host values in cta-admin commands
91

92
### Bug fixes
93
94
95
96
- cta/CTA#501 cta-taped should set the state to DOWN when machine rebooting
- cta/CTA#955 cta-taped daemon should stop "immediately" and cleanly when systemctl stop/restart is executed
- cta/CTA#991  Drive is not put down if the device file is removed while cta-taped is running and before a data transfer
- cta/CTA#996  Removes PARALLEL from migration scripts
97
- cta/CTA#1029 Fix segmentatin fault in frontend when list repacks of a tape that has been deleted in the catalogue
98
- cta/CTA#1031 Fix Warning in updateDriveStatus
Jorge Camarero Vera's avatar
Jorge Camarero Vera committed
99
- cta/CTA#1032 cta-admin dr ls crashes the frontend if executed during an archive/retrieve
100
101
102

# v4.2-3

103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
## Summary

### Features
- cta/CTA#983
  - Add cta-versionlock helper script to cta-release package
  - Update cta repo file to use the new public repo
- cta/CTA#1036 Better error reporting in cta-admin tools
- cta/CTA#1039 Improve logging of cta admin commands in cta frontend
- cta/CTA#1041 Fix host values in cta-admin commands
- cta/CTA#1026 `cta-admin sq` now shows the mount policies of potential mounts

### Bug fixes
- cta/CTA#1029 Fix segmentatin fault in frontend when list repacks of a tape that has been deleted in the catalogue
- cta/CTA#1032 cta-admin dr ls crashes the frontend if executed during an archive/retrieve
- cta/CTA#996  Removes PARALLEL from migration scripts
- cta/CTA#1035 log configuration options on frontend startup
- cta/CTA#1042 Do not iterate over retrieve queues when holding global scheduler lock
  - Repacks on a disabled tape must now use a mount policy whose name starts with repack
  - There is no longer an empty mount when a disabled/broken tape queue is full of deleted requests
- cta/CTA#1027 Mitigate popNextBatch bad behaviour in archive queues
- Migration tools: fixes filemode of files imported from CASTOR to EOS

125
126
127
128
129
# v4.2-2

## Summary

### Features
130
131
132

### Bug fixes
- cta/CTA#1029 Fix segmentatin fault in frontend when list repacks of a tape that has been deleted in the catalogue
133

134
135
136
137
138
# v4.2-1

## Summary

### Features
139
- Catalogue schema version 4.2
140
- cta/CTA#1001 Maximum file size is now defined by VO instead of globally.
141
142
- cta/CTA#1019 New command `cta-readtp` allows reading files from tape and verifying their checksum

143
144
145
146
147
# v4.1-1

## Summary

### Features
148
- Catalogue schema version 4.1
149
150
151
- cta/CTA#1016 New options for filtering deleted files using `cta-admin rtf ls` command.
- cta/CTA#983 Add cta-release package for public binary rpm distribution.
- cta/CTA#980 Add external encryption script option
Jorge Camarero Vera's avatar
Jorge Camarero Vera committed
152
- cta/CTA#976 Define a new table in the DB schema to contain the drive status.
153
- cta/CTA#834 New command "recycletf restore" allows undeleting a copy of a file from tape deleted using tapefile rm
154
155
- [frontend] New command "tapefile rm" allows deleting a copy of a file from tape

156
157
### Bug fixes

158
- cta/CTA#1014 Fix last column alignment when more than 1000 items are listed.
159

160
161
162
163
# v4.0-5

## Summary

164
### Features
165
166
167
168
- [frontend] Add options to "tapepool ls" to filter tapepools on their name, vo and encryption
- cta/CTA#898 cta-send-event now gets the requester id and eos instance as command line arguments
- cta/CTA#1005 "tape ls" now can filter tapes on wether they were imported from CASTOR
- cta/CTA#1006 "repack ls" now shows the tapepool of the tape being repacked
169

170
171
### Bug fixes

172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
# v4.0-5

## Summary

### Features
- [frontend] Add options to "tapepool ls" to filter tapepools on their name, vo and encryption
- cta/CTA#898 cta-send-event now gets the requester id and eos instance as command line arguments
- cta/CTA#1005 "tape ls" now can filter tapes on wether they were imported from CASTOR
- cta/CTA#1006 "repack ls" now shows the tapepool of the tape being repacked

### Bug fixes

- [frontend] Adds missing break after "schedulinginfo ls" command
- cta/CTA#999 Adds a default mount rule
- cta/CTA#1003 The expansion of a repack request now fails if the archive route for archiving the repacked files is missing

# v4.0-4

### Bug fixes

- cta/CTA#1002 Do not requeue report jobs when reportType is NoReportRequired

# v4.0-3

### Features

- Upgraded ceph to version 14.2.20
- Adds cta-verify-file to cta-cli RPM

201
202
203
204
205
206
# v4.0-2

## Summary

### Features

Julien Leduc's avatar
Julien Leduc committed
207
208
209
- Upgraded EOS to 4.8.45 in CI versionlock.list file
  - EOS/EOS-4658 EOS workflow engine should not insist on the W_OK mode bit (for prepare ACL)
  - EOS/EOS-4684 Make the "file archived" GC aware of different EOS spaces
210
- Upgraded eos-xrootd to 4.12.8 in CI versionlock.list file
211
- cta/CTA#966 Unable to distinguish empty and wrong tape pool
212
- cta/CTA#926 Improve MigrationReportPacker::ReportSkipped::execute() exception message
Michael Davis's avatar
Michael Davis committed
213
- cta/CTA#584 Validate checksum when recalling from tape
214

215
216
### Bug fixes

Michael Davis's avatar
Michael Davis committed
217
218
219
- cta/CTA#582 Changes cta-admin storageclass add --copynb to --numberofcopies
- cta/CTA#987 Do not import metadata for zero-length files into CTA Catalogue
- cta/CTA#984 Removes diskFileGid == 0 check
220
- cta/CTA#669 cta-taped now display the correct error message when the drive device does not exist
221
- cta/CTA#777 Minimize mounts for dual copy tape pool recalls - Temporary fix
222
223
- cta/CTA#927 Bad message for archive route pointing non-existing pool
- cta/CTA#930 Batched the queueing and the deleting of the repack subrequests
224
- cta/CTA#969 `xrdfs query prepare` malformed JSON output
Michael Davis's avatar
Michael Davis committed
225
- cta/CTA#972 Updates cta-taped and rmcd man pages
226
- cta/CTA#967 CI DB cleanup issues
227
- cta/CTA#982 cta-fst-gcd ignored eos files with fid>4294967295
228
- cta/operations#352 Unable to delete empty tape pool
229

230
231
232
233
234
235
236
237
238
# v4.0-1

## Summary

This version contains the last and clean version of the CTA catalogue schema. This CTA version can not run anymore with the
CTA v3.1-14.

### Features

239
- Catalogue schema version 4.0
240
- cta/CTA#964 Adds failure log messages to processCLOSEW in CTA Frontend
241
242
- When the operator submits a tape to repack, a check is done about the tape state before queueing the repack request to ensure it can be repacked
- Oracle catalogue migration scripts 3.1to3.2.sql: replaced DELETE FROM table_name by TRUNCATE TABLE table_name
243

244
245
246
247
# v3.2-1

## Summary

248
This version is a transition version between CTA v3.1-14 and CTA v4.0. The functionalities of the v4.0 are implemented,
249
250
251
252
253
but at the database level, the columns to be deleted have been put as NULLABLE and the NOT NULL columns to be added as NULLABLE.
The xrootd-ssi-protobuf-interface is not up-to-date with the CTA v4.0: deprecated fields have not been removed.

### Features

254
- Catalogue schema version 3.2
255
256
257
258
259
260
261
262
- Upgraded EOS to 4.8.37-1
- cta/CTA#922 The superseded concept has been removed and replaced by a new recycle bin
- cta/CTA#943 A new tape lifecycle logic has been implemented
- cta/CTA#948 The max drives allowed for reading and writing are now set per virtual organization and not per mount policy anymore
- cta/CTA#952 Reclaiming a tape resets the IS_FROM_CASTOR flag to 0
- cta/CTA#951 The query used by RdbmsCatalogueTapeContentsItor has been put back to the state it was in v3.1-13
- cta/CTA#883 Tape verification tool

263
264
265
266
# v3.1-14

## Summary

267
268
### Features

269
- Upgraded EOS to 4.8.35-1
270
- cta/CTA#954 The drive is put down if the CleanerSession fails to eject the tape from it after a shutdown
271
- cta/CTA#945 The timeout for tape load action is now configurable
272

273
274
275
### Bug fixes

- cta/CTA#957 The state of the successful Archive for repack jobs is now changed before being queued for reporting
276
- cta/CTA#958 The RepackRequest garbage collection now changes the owner of the RepackRequest
277

278
279
280
281
282
283
# v3.1-13

## Summary

### Features

284
285
286
- Upgraded EOS to 4.8.34-1
- Upgraded xrootd to 4.12.6-1

287
288
289
### Bug fixes

- cta/CTA#941 Slow `cta-admin sq` even when there is very little activity
290
291
- cta/CTA#951 Improve the performance of RdbmsCatalogueTapeContentsItor
- cta/CTA#939 cta-objectstore-dereference-removed-queue removes all kind of manually deleted queues from the RootEntry
292

293
294
295
296
297
298
# v3.1-12

### Features

- Upgraded EOS to 4.8.30-1

299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
# v3.1-11

### Features

- cta/CTA#932 Add environment file for cta-frontend service: frontend configured to use 10 XRootD polling threads by default
- cta/CTA#292 Allow non interactive usages of cta-admin with sss authentication
- Upgraded EOS to 4.8.29-1
   - cta/operations#155 Fix for conversion issues
   - cta/operations#154 Improve sys.retrieve.req_id to allow to cancel retrieves on a running instance: adding epoch timestamp in ids
   - EOS-4505 Separate archive and retrieve ACLs in EOS: only needs p ACL for prepare

### Bug fixes

- cta/operations#150 high priority Archive job not scheduled when Repack is running: fixed

314
315
316
317
# v3.1-10

## Summary

318
This version contains different bug fixes
319

320
321
322
323
### Features

Unuseful WARNING logs are now DEBUG logs

324
325
326
### Bug fixes

cta/CTA#837 Repack now fails if the repack buffer VID directory cannot be created during expansion
327
328
cta/CTA#920 Archive and Retrieve error report URL correction on the cta-send-event cmdline tool
cta/CTA#923 Corrected the cta-admin showqueues command to display all the retrieve queues of tapes that are on the same tapepool
329

330
331
332
333
334
335
336
337
338
339
340
# v3.1-9

## Summary

This release contains an improvement allowing to fetch the EOS free space via an external script for backpressure

### Features

- Upgraded EOS to 4.8.26-1
- cta/CTA#907 For backpressure, the EOS free space can be fetched by calling an external script

341
342
343
### Bug fixes

- cta/CTA#917 Corrected the bug in the cta-admin showqueues command in the case ArchiveForUser and ArchiveForRepack exist for the same tapepool
344
- cta/CTA#919 Archive queue oldestjobcreationtime is now updated at each pop from the ArchiveQueue
345

346
347
348
349
350
351
352
353
354
# v3.1-8

## Summary

This release contains the CTA software Recommended Access Order (RAO) implemented for LTO drives to improve retrieve performances

### Features

- CTA software Recommended Access Order (RAO) implemented for LTO drives
355
- Upgraded EOS to 4.8.24-1
356
- Upgraded xrootd to 4.12.5-1
357
- cta-admin repack ls tabular output improvements
358
- Repack management execution can be disabled via the cta-taped configuration file
359
- cta/CTA#907 Maintenance process can be disabled via the cta-taped configuration file
360
361
362
363

# Modifications

- Catalogue refactoring
364

365
366
### Bug fixes

367
- cta/CTA#901 cta-admin tapefile ls too slow
368
- cta/CTA#895 [catalogue] RdbmsCatalogue::deleteLogicalLibrary does not delete empty logical library
369
- utils::trimString() now returns an empty string if the string passed in parameter contains only white-space characters
370
- Repack request and sub-requests are now unowned from their Agent when completed
371

372
373
374
375
376
377
378
379
380
381
# v3.1-7

## Summary

This release contains a correction of a performance issue introduced in the v3.1-6 version

### Bug fixes

- cta/CTA#893 Corrected slowliness of RdbmsCatalogue::getArchiveFileToRetrieveByArchiveFileId()

382
# v3.1-6
Steven Murray's avatar
Steven Murray committed
383
384
385
386
387
388
389

## Summary

This release contains some minor improvements.

### Features

390
- cta/CTA#881 cta-fst-gcd logs can be now sent to stdout by command line option for container based deployments
Steven Murray's avatar
Steven Murray committed
391
392
393
394
395
396
- cta/CTA#885 cta-admin should be able to query by sys.archive.file_id
- Upgraded EOS to 4.8.15-1
- Upgrading xrootd from 4.12.3-1 to 4.12.4-1

### Modifications

397
- cta/CTA#890 CTA RPMs should only use the xrootd-client-libs package
398
- buildtree installation scripts are made compatible with Centos 7
Cedric Caffy's avatar
Cedric Caffy committed
399
400
- cta/CTA#892 Modified the log level of the triggering of Archive and Retrieve mounts
- cta/CTA#889 It is not possible to retrieve a file that is not active anymore
Steven Murray's avatar
Steven Murray committed
401
402
403
404

### Bug fixes

- cta/CTA#877 ObjectStore.RetrieveQueueAlgorithms unit tests fails or succeeds base on version of cmake
Cedric Caffy's avatar
Cedric Caffy committed
405
406
- cta/CTA#888 Garbage collector race condition
- cta/CTA#891 Corrected Repack Archive subrequest creation time
Steven Murray's avatar
Steven Murray committed
407

408
# v3.1-5
409
410
411

## Summary

412
This release is a bug fix release.
413
414
415

### Features

416
- cta/CTA#863 Prevent SQLite database files from being used as the CTA catalogue database backend
417
- cta/CTA#870 Adds "cta-admin failedrequest rm" command
418
419
420

### Modifications

Michael Davis's avatar
Michael Davis committed
421
422
- cta/CTA#861 cta-admin comment column is flush left

423
424
### Bug fixes

425
426
- cta/CTA#862 Unable to delete tabtest tape pool because it is in an archive route
- cta/CTA#860 Correct contents of cta-lib-catalogue RPM and correct dependencies on it
427
- Reinstates missing "cta-admin failedrequest ls --summary" option
Cedric Caffy's avatar
Cedric Caffy committed
428
- cta/CTA#865 Empty the RetrieveQueue in the case of cancellation of a retrieve request when the drive is down
429

430

431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
# v3.1-4

## Summary

This release improves database performance, improves the `cta-admin`
command-line tool based on operator requests and removes the deprecated
`cta-objectstore-unfollow-agent` command again for the benefit of operators.

### Modification

- cta/CTA#858 Remove dependency between the cta-migration-tools RPM and librados2
- cta/CTA#857 Remove unnecessary LEFT OUTER JOIN clauses from the CTA catalogue
- cta/CTA#852 Fixing sqlite CI use case
- cta/CTA#850 [repack] If the --no-recall flag is passed to the repack request submission the --disabled-flag test should not be done.
- cta/CTA#846 cta-admin tapefile ls: list by fileid
- cta/CTA#840 Remove cta-objectstore-unfollow-agent from cta-objectstore-tools

448

449
450
451
452
453
454
# v3.1-3

## Summary

### Features

455
- Upstream eos 4.8.10-1
456
457
458
459
  - Adds a fix for `eos-ns-inspect` to [correctly list extended attributes on files](https://its.cern.ch/jira/browse/EOS-4319)
- The `--no-recall` flag can be passed to `cta-admin repack add` command:
  - The repack request will NOT trigger any retrieve mount.  Only the files that are in the repack buffer will be considered for archival. This is used to inject recoverred files from a tape with some hard to read fseqs.
- New `cta-admin schedulinginfos ls` command available to list potential mounts detected by the scheduler
460
461
462

### Modification

463
- Shrinked `cta-admin repack ls` tabular output
464
465
- cta-admin help commands listed in alphabetical order
- Catalogue connection pool improvements
466
- The scheduler will take the tape that has the highest occupancy for archival in order to limit data scattering across all available tapes
467

468

469
470
471
472
# v3.1-2

## Summary

473
### Modification
474
475
476

- Added database upgrade/changelog script oracle/3.0to3.1.sql

477

478
479
480
481
482
483
484
485
486
487
488
# v3.1-1

## Summary

### Modification

- Corrected bugs on cta-objectstore-create-missing-repack-index tool
- Corrected a bug that caused crash of all tapeservers while scheduling
- Catalogue schema version 3.1 : addition of a new index on the TAPE table
- Catalogue and Unit tests improvements

489

490
491
492
493
494
495
496
497
# v3.0-3

## Summary

### Modification

- The cta-statistics-update tool updates the tape statistics one by one

498

499
500
501
502
503
504
505
506
507
508
509
510
# v3.0-2

## Summary

### Features

- Upstream eos 4.8.3-1
- Upstream xrootd 4.12.3-1
- Mount policies are now dynamically updated on queued Archive and Retrieve requests
- ShowQueues now display queued retrieves on disabled tapes


Cedric Caffy's avatar
Cedric Caffy committed
511
512
513
514
515
516
# v3.0-1

## Summary

### Features

517
518
- Upstream eos 4.8.2-1
- Upstream xrootd 4.12.1-1
Cedric Caffy's avatar
Cedric Caffy committed
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
- Catalogue schema updated to version 3.0
- Catalogue production is protected against dropping
- Management of media types
- File recycle-bin for file deletion
- cta-admin drive ls display reason in tabular output
- cta-send-event allowing to manually retry to Archive or Retrieve a file
- KRB5 authentication for CLOSEW and PREPARE events
- prevent eos /eos/INSTANCE/proc/conversion worfklows from deleting files from CTA

### Modifications

- Tape comments are optional and can be removed
- Workflow triggered by a file that is in /proc will not trigger anything on CTA side
- CASTOR-TO-CTA migration adapted to new schema
- Repack submission will fail if no mount policy is given

### Bug fixes

- Fixed archive failure requeueing with no mount policies


540
541
542
543
544
545
546
547
548
549
550
# v2.0-5

## Summary

### Features

- Upstream eos 4.7.12-1
- Added support for FileID change in EOS that occurs during conversion
  - fileID updated in the catalogue when frontend receives Workflow::EventType::UPDATE_FID event


Julien Leduc's avatar
Julien Leduc committed
551
552
553
554
555
556
557
558
559
560
561
# v2.0-3

## Summary

### Features

- Upstream eos 4.7.9-1
- Adding reason and comment to cta drive objects
  - Allow to better track tape drive usage in production
  - Allow to track reasons that conducted a drive to be set down

562

Julien Leduc's avatar
Julien Leduc committed
563
# v2.0-2
Julien Leduc's avatar
Julien Leduc committed
564

Julien Leduc's avatar
Julien Leduc committed
565
566
## Summary

Julien Leduc's avatar
Julien Leduc committed
567
### Features
Julien Leduc's avatar
Julien Leduc committed
568
569
570
571
572
573
574
575
576

- Upstream eos 4.7.8-1
- Upstream xrootd 4.11.3-1
- Upstream ceph nautilus 14.2.8-0
- Fix for xrdfs query prepare `on_tape` logic
- More tests on the tape drive
  - Chech that device path exists
  - No drive name duplication allowed anymore in objectstore

577
578
579
580
# v2.0-1

## Summary

581
### Features
582
583
584
585
586
587
588
589
590

- New schema version 2.0
  - *VIRTUAL_ORGANIZATION* has its own table
  - *DISK_FILE_PATH* is now resolved on eos instance using grpc and not duplicated anymore in tape catalogue
- Upstream eos 4.7.2-1 (CentOS 7 packages)
- Upstream xrootd-4.11.2-1 for CTA

**Upgrade from previous catalogue version is not provided**

591
# v1.2-0
Cedric CAFFY's avatar
Cedric CAFFY committed
592
593
594

## Summary

595
### Features
Cedric CAFFY's avatar
Cedric CAFFY committed
596
597
598
599

- cta-admin tapefile ls command: list the tape files located in a specific tape
- New schema verification tool (cta-catalogue-schema-verify)
- New tape statistic updater tool (cta-statistics-update)
600
- CTA Frontend has configurable maximum file size limit (cta.archivefile.max_size_gb), default 2TB
Cedric CAFFY's avatar
Cedric CAFFY committed
601
602
603
604
605
606
607
608
609

### Modifications

- Backward-compatible Catalogue schema changes:
  - CTA_CATALOGUE table contains a status that can be 'UPGRADING' or 'PRODUCTION'. If the status is UPGRADING, the columns NEXT_SCHEMA_VERSION_MAJOR and NEXT_SCHEMA_VERSION_MINOR will contain the future version number of the schema.
  - INDEXES and CONSTRAINT renaming to follow the [naming convention](https://eoscta.docs.cern.ch/catalogue/naming_convention/)
  - UNIQUE CONSTRAINT on ARCHIVE_ROUTE (UNIQUE(STORAGE_CLASS_ID, TAPE_POOL_ID))
  - Creation of an INDEX ARCHIVE_FILE_DFI_IDX on ARCHIVE_FILE(DISK_FILE_ID)
  - Added 3 columns to the TAPE table : NB_MASTER_FILES, MASTER_DATA_IN_BYTES, DIRTY
610
611
612
- Minor changes to cta-admin command syntax
- New configuration file for gRPC namespace endpoints so CTA can query EOS namespace
- Archive requests sent to hard-coded fail_on_closew_test storage class will always fail with an error
Cedric CAFFY's avatar
Cedric CAFFY committed
613
614
615
616
617

### Bug fixes

- The scheduler does not return a mount if a tape is disabled (unless if the tape is repacked with the --disabledtape flag set)

618
### Improvements
Cedric CAFFY's avatar
Cedric CAFFY committed
619
620

- CASTOR-To-CTA migration improvements
621
622
623
- Better cta-admin parameter checking and column formatting
- cta-admin --json handles user errors from the Frontend by outputting an empty array [] on stdout and error message on stderr. Error code 1 is returned for protocol errors and code 2 is returned for user errors.
- CTA Frontend logs which FST sent the archive request
Cedric CAFFY's avatar
Cedric CAFFY committed
624
625
626

## Package changes

627
- eos-4.6.8 which brings the delete on close feature
Cedric CAFFY's avatar
Cedric CAFFY committed
628
629
630
631
632
633
634
635
636
637
638
639

## Upgrade Instructions from v1.0-3

### 1. Upgrade the Catalogue schema version from version 1.0 to 1.1

Before updating CTA, the Catalogue schema should be upgraded. Here is the link to the documentation about the database schema updating procedure : [https://eoscta.docs.cern.ch/catalogue/upgrade/](https://eoscta.docs.cern.ch/catalogue/upgrade/)

The liquibase changeLog file is already done so you can directly run the [*liquibase update*](https://eoscta.docs.cern.ch/catalogue/upgrade/backward_compatible_upgrades/#3-run-the-liquibase-updatesql-command) command with the changeLogFile located in the directory *CTA/catalogue/migrations/liquibase/oracle/1.0to1.1.sql*.

### 2. Update CTA components

TODO : Instructions about how to update the tapeservers and the frontend.