Developed at the Florida Institute of Technology
Lead Author: Scott Demarest
Supervisor: Souvik Das
Lead Author: Scott Demarest
Supervisor: Souvik Das
Panthera is a web-based platform to store, analyze, and grade test results of detector modules for the CMS Phase II Inner Tracker. It provides structured data handling, intuitive user access, and robust grading tools to support quality control and decision-making in module production. Results, which include characterizations and calibrations, are primarily uploaded to Panthera from the testing software at Assembly and Test Sites, OSU-GUI and Dirigent. Manual uploads are possible via the web-interface but not recommended. Panthera is also a grader that can analyze the test results and grade modules based on pre-defined rubrics. Finally, Panthera generates statistical plots to monitor module performance across production cycles. The web-interface aims to be intuitive, featuring hover-tooltips throughout. [Watch the tutorial video here]
Test Results exist within Sequences, wherein they are ordered. This is because a characterization Result may only make sense after certain calibrations, and therefore must be understood within context. A module may undergo a sequence of tests at a Test Site and then be sent to another Test Site where the same sequence is repeated. The two sequences may reveal different results, depending on ambient conditions or if the transportation was rough. Panthera stores all Sequences of Results to preserve contextual history of every module.
To facilitate the repeated and rapid grading of modules, each Result, which is often summarized in a ROOT file, is analyzed once by Panthera to produce key numbers relevant for grading. The set of key numbers for all Results in a Sequence is called an “Actionable Summary”. The Actionable Summary is used to grade a Sequence, based on a Rubric. Thus, for a given module, a Grade is associated with a Sequence. This allows us to track performance shifts due to damage, repair, or transport. Each module has a “Golden Sequence” that is used to determine if it makes the grade to get on the experiment.
Rubrics are human-written JSON files specifying selection criteria for grading that are applied to a Sequence’s Actionable Summary. Each selection criterion results in a pass or fail. The number of fails in a Sequence is its Grade (Grade 0 = perfect). All Grades are stored with reference to the Rubric applied and the Sequence it was applied to. Sequences can be graded individually for a module. Or, all Sequences in all Modules can be graded in bulk.
Access to the various functionalities of Panthera are restricted by privilege level. A Viewer can search for and view modules’ Results, Grades and Rubrics. A Shifter can upload test Results from OSU-GUI or Dirigent and has all Viewer privileges. A Leader can review and grade Sequences based on existing Rubrics and has all Shifter privileges. A Conductor can create Rubrics and bulk-regrade modules, and has all Leader privileges.
The different but related functions of Panthera are accessible through the tab buttons above. "Find Modules" leads to a page that allows Viewers+ to search for modules by selection criteria and view their history of test Results grouped in Sequences and Grades. "Review Modules" allows Leaders+ to review and grade modules. "Manage Rubrics" allows Conductors to create and try Rubrics. “Add Modules” allows Leaders+ to manually add modules to the system that have not been added by OSU-GUI or Dirigent, and to edit some of their attributes such as location. "Upload Mechanical" allows Leaders+ to upload pictures and plots related to the mechanical integrity of the module. "Upload Electrical" allows Leaders+ to upload Sequences of Results manually.
Panthera’s main database is MySQL and the web-application is written in PHP. A Python package called Felis complements Panthera by interfacing with OSU-GUI and Dirigent, analyzing ROOT files, and uploading them to the database. Panthera is hosted on a server at Florida Tech with 60 TB RAID 6 storage and gigabit optical fiber connectivity. For questions, bug reports, or feature requests, contact us at sdemarest2019@my.fit.edu and sdas@my.fit.edu.
