Canaries
Monitor LLMs during training (white-box hooks) and at inference (black-box probing) for secret leakage and canary/watermark emergence.
Features
- Canary registry to track synthetic watermarks planted in training data.
- Probe suite for templated prompts to elicit memorization (completion, verbatim, extraction, among others).
- Secret detectors for pattern matching (AWS keys, JWT, email, SSN) + entropy scoring.
- White-box = trainer callback for step/checkpoint probing.
- Black-box = API and local HTTP inference probing.
- Alerting = stdout, JSONL audit log, optional webhook.