Skip to main content

Webmon Configuration

Webmon database​

To enable automated data ingress to Galaxy, we need to configure tasks for the specific instrument we want to monitor (there is no option to configure for all instruments at once).

So we need:

  1. Go to webmon database. One needs admin access for that. Ask Marie Backman
  2. Filter specific instrument in the right panel
  3. Click on ID to edit a task list
  4. Add CALVERA.RAW.DATA_READY and CALVERA.RAW.COMPLETE to two task queue lists - CATALOG.REQUEST and POSTPROCESS.DATA_READY. The latter is most important - it is used for automated processing. CATALOG.REQUEST - optional, if you want to manually execute the ingress task from WebMon interface.
  5. CALVERA.RAW.COMPLETE to the list of Success Queues

So, after the changes the table might look like this:

queue_list_example.png

note

Currently, if you edit an old record (or add a new one), please set Task Class to " "(space), otherwise it does not work

Postprocessing Agents​

Postprocessing agents are configured to listen to the AMQ queues defined above and send data to Calvera. The configuration is managed by SNS Linux Support Team via Puppet, here is the snippet related to Calvera:

{
  ...
  "processors": [
    ...
    "calvera_processor.CalveraProcessor",
    "calvera_processor.CalveraReducedProcessor"
  ],
  "calvera_ingest_url": "http://<ingress_proxy_ip>:<proxy_port>/v0.1/ingress"
}
note

For ingress_proxy_ip in calvera_ingest_url use the IP for ingress proxy VM. Port is configured in Ansible playbook as proxy_port