Shane AO  

Welcome/Index | Architecture | Procedures | Problems | Features | Documents | Resources | Chronology  



Problem: No heartbeat from dispatcher for Woofer service

Manifestation:

  • If present at console, eventsounds emits audible warning.
  • Electronic mail with subject: ShaneAO: No heartbeat from dispatcher for Woofer service with the following content:
     
       No heartbeat keyword has been received from the 
       dispatcher for Woofer service, (keyword wooferao.HEART) in 1.0 minutes 
        
       [Tracking information: this email from dispatcher #2 is part of the 
       actionlist for WOOFER, and was triggered by an update to keyword: 
       SERVICESSTA (Dcounter=46743804). dinfo = onchange/3/6] 
       

Solution/Recovery:

Level 1:

  • ping musher.ucolick.org — Verify no communication with woofer controller.
  • In ShaneAO Power Controls, power-cycle outlet B2 musher computer OFF and ON.
  • ping musher.ucolick.org — Verify communication with woofer controller.

Level 2 (if level 1 unsuccessful):

  • Exit shaneao real-time code: In ShaneAO window, hit return/enter to acquire a python (>>>) prompt; type exit().
  • Exit ShaneAO - peeko: In Peeko terminal, hit return/enter to acquire a python (>>>) prompt; type exit().
  • Exit ShaneAO - tt peeko: In TT Peeko terminal, hit return/enter to acquire a python (>>>) prompt; type exit().
  • Quit ShaneAO loop control GUI: Under menu item File..., Quit.
  • In ShaneAO Power Controls, power outlet B1 rtc/real computer OFF (for at least 120 s).
  • In ShaneAO Power Controls, power outlet B2 musher computer OFF (for at least 120 s).
  • In ShaneAO Power Controls, power outlet B1 rtc/real computer ON.
  • In ShaneAO Power Controls, power outlet B2 musher computer ON.
  • Restart instrument monitoring services:

    user@shadow: /usr/local/lick/bin/ao restart saomon

  • From workspace pull-down menu, (re-)launch ShaneAO loop control GUI.
  • From workspace pull-down menu, (re-)launch shaneo real-time code.
  • From workspace pull-down menu, (re-)launch Peeko display.
  • From workspace pull-down menu, (re-)launch TTPeeko display.
  • In ShaneAO loop control GUI: WFS camera reset, TT camera reset, WFS camera dark TT camera dark.

Cause:

  • Power/network/communication glich(es).
  • Crash of musher.ucolick.org.
  • Associated Issues:

    Change Log:

    2025-03-03: Updated.
    2016-11-20: Updated.
    2015-04-01: First version.

This document last updated (UTC): Tuesday 04 March 2025