Memory Compression System v3.0

Integrated memory management and extreme context compression for OpenClaw. Combines the best features of memory management and extreme compression into a single, streamlined skill with automatic scheduling.

Quick Start

CODEBLOCK0

Features

1. Integrated Memory Management

• - Automatic compression: Every 6 hours (00:00, 06:00, 12:00, 18:00 UTC)
• Smart cleanup: Daily cleanup of old files
• Search functionality: Unified search across all memory files
• Backup system: Automatic backups before compression

2. Three Compression Formats

• - Base64 Compact (B64C): Universal compatibility, ~40% reduction
• Custom Binary (CBIN): Optimized binary, ~70% reduction
• Ultra Compact (UCMP): Extreme compression, ~85% reduction, target ~150 tokens

3. Automated Scheduling

• - Single cron job: No overlapping schedules
• Configurable: Adjust frequency and timing
• Reliable: Built-in error recovery and logging
• Efficient: Minimal resource usage

4. Search & Retrieval

• - Unified search: Across all memory formats
• Fast indexing: Real-time search updates
• Context aware: Understands compressed formats
• Export options: Search results in multiple formats

5. ClawHub Ready

• - Standard structure: Compatible with ClawHub
• Easy installation: One-command setup
• Health checks: Built-in monitoring
• Documentation: Comprehensive guides

Installation

Via ClawHub (Recommended)

Manual Installation

Usage

Basic Operations

Compression Operations

Search Operations

Management Operations

Configuration

Main Configuration File

Environment Variables

Compression Formats

Format 1: Base64 Compact (B64C)

Features:

• - Human readable
• Easy debugging
• Universal compatibility
• CRC32 integrity check

Format 2: Custom Binary (CBIN)

Features:

• - Optimized binary format
• Shared string dictionary
• Huffman encoding
• CRC16 integrity check

Format 3: Ultra Compact (UCMP)

Features:

• - Extreme compression (~85% reduction)
• 3-letter abbreviations
• Bit packing
• Delta encoding
• String interning

Automatic Scheduling

Compression Schedule

• - Every 6 hours: 00:00, 06:00, 12:00, 18:00 UTC
• Operations:

Cleanup Schedule

• - Daily at 04:00 UTC
• Operations:

Health Check Schedule

• - Integrated with OpenClaw health checks
• Operations:

Search System

Search Index

• - Real-time updates: Index updates after each compression
• Multiple formats: Searches across all compression formats
• Fast retrieval: Optimized for speed
• Context aware: Understands compressed content

Search Features

Search Index Structure

Error Handling & Recovery

Automatic Recovery

• - Backup system: Automatic backups before operations
• Transaction logs: All operations logged
• Rollback capability: Automatic rollback on failure
• Error notifications: Alerts for critical issues

Manual Recovery

Common Issues & Solutions

Issue: Compression fails
Solution: Check disk space and run INLINECODE1

Issue: Search not working
Solution: Rebuild index with INLINECODE2

Issue: Cron job not running
Solution: Check with INLINECODE3

Issue: Performance degradation
Solution: Run INLINECODE4

Monitoring & Logging

Log Files

• - logs/compression.log: Compression operations
• INLINECODE6: Search operations
• INLINECODE7: Error messages
• INLINECODE8: Performance metrics
• INLINECODE9: Cron job execution

Status Monitoring

Alert System

• - Email alerts: For critical errors (if configured)
• Telegram notifications: For important events
• Log monitoring: Automatic log analysis
• Performance alerts: For resource issues

Testing

Test Suite

Test Coverage

• - Unit tests: Format encoding/decoding
• Integration tests: Full system integration
• Performance tests: Speed and memory usage
• Error tests: Failure scenarios
• Cron tests: Automatic scheduling

Manual Testing

Performance

Compression Performance

• - Base64: < 50ms for 10KB
• Binary: < 100ms for 10KB
• Ultra: < 200ms for 10KB
• Target ratio: 75-90% reduction

Search Performance

• - Indexing: < 100ms per file
• Search: < 50ms for 1000 files
• Memory: < 10MB for index
• Updates: Real-time

Resource Usage

• - CPU: Minimal impact
• Memory: < 50MB peak
• Disk: Configurable retention
• Network: Local only

Updates & Maintenance

Update Procedure

Backup Recommendations

• - Regular backups: Weekly backups of data/ directory
• Export search index: Monthly export of search index
• Archive logs: Monthly log archiving
• Configuration backup: Backup config/ after changes

Version History

• - 3.0.0: Integrated memory-compression-system (current)
• 2.0.0: Extreme context compression skill
• 1.0.0: Memory manager skill

Contributing

Development Setup

Code Standards

• - Bash scripts: Follow Google Bash Style Guide
• JavaScript: Follow Standard JS style
• Documentation: Keep SKILL.md updated
• Testing: Add tests for new features

Pull Request Process

1. 1. Fork the repository
2. Create feature branch
3. Add tests for new functionality
4. Update documentation
5. Submit pull request

Support

Documentation

• - SKILL.md: This file
• README.md: User documentation
• examples/: Usage examples
• test/: Test examples

Troubleshooting

1. 1. Check logs/ directory
2. Run INLINECODE13
3. Review INLINECODE14
4. Contact maintainer if needed

Community

• - ClawHub: Skill repository
• Discord: OpenClaw community
• GitHub: Issue tracker
• Documentation: OpenClaw docs

License

MIT License - See LICENSE file for details.