Universal Video to S3 Uploader v3.0.1

A universal video downloader that supports multiple platforms and uploads to S3-compatible storage.

🚀 Version 3.0.1 - Filename Optimization

What's New:

• - ✅ Clean Filenames: Removes all punctuation marks, emojis, and special characters from filenames
• ✅ Better Unicode Support: Proper handling of Chinese punctuation and emojis
• ✅ Platform Detection: Automatic detection of video platform (YouTube, Twitter/X, TikTok, etc.)
• ✅ Universal Support: Works with 1000+ websites via yt-dlp

Breaking Changes:

• - ❌ NOT backward compatible: v3.x is a complete rewrite from v2.x
• ❌ New API: Universal video-to-s3-universal.js script
• ❌ Platform Detection: Automatically detects video platform

Why v3.0.1?

1. 1. Clean filenames - Removes all punctuation and emojis
2. Better S3 compatibility - Avoids issues with special characters
3. Improved readability - Clean, readable filenames without clutter

What's New:

• - ✅ S3 Multipart Upload for All Files: v2.0.0 uses S3 multipart upload for all file sizes
• ✅ Memory Optimization: Chunked reading to avoid memory overflow
• ✅ Error Recovery: Automatic retry mechanism for failed uploads
• ✅ Smart Chunk Sizing: Automatically adjusts chunk size based on file size
• ✅ Performance Improvements: Better progress tracking and speed calculation
• ✅ Fixed Help System: Proper help information display

Breaking Changes:

• - ❌ NOT backward compatible: v2.0.0 is a complete rewrite
• ❌ Old scripts removed: All v1.x scripts have been replaced
• ❌ New API: Uses S3 multipart upload for all files, not just large ones

Why v2.0.0?

1. 1. Fixed help system - Proper --help display
2. Consistent API - Always uses multipart upload
3. Better error handling - Improved error messages
4. Cleaner codebase - Removed compatibility layers

Features

• - One-command workflow: Download YouTube video → Upload to S3 → Get access URL
• S3-compatible: Works with Cloudflare R2, AWS S3, MinIO, and any S3-compatible storage
• Automatic cleanup: Removes local files after successful upload
• Progress tracking: Real-time upload progress and speed calculation
• Secure by default: Uses your own S3 credentials, no external dependencies
• Flexible configuration: Multiple bucket support, custom paths, metadata
• Smart upload method: Automatically uses S3 Multipart Upload for large files (>50MB)
• Memory efficient: Chunked reading to avoid memory overflow
• Error recovery: Retry mechanism for failed uploads

Prerequisites

1. 1. S3-compatible storage (Cloudflare R2, AWS S3, MinIO, etc.)
2. S3 credentials (Access Key ID and Secret Access Key)
3. Bucket created with appropriate permissions

Quick Start

1. Install the skill

CODEBLOCK0

2. Configure your S3 storage

Create ~/.youtube-s3-uploader.yml:

CODEBLOCK1

3. Download and upload a YouTube video

CODEBLOCK2

Configuration Details

Cloudflare R2 Example

CODEBLOCK3

AWS S3 Example

CODEBLOCK4

MinIO / Self-hosted Example

CODEBLOCK5

Usage

Basic usage

CODEBLOCK6

Upload existing video file

CODEBLOCK7

Test S3 connection

CODEBLOCK8

Output

After successful processing, you'll get:

CODEBLOCK9

Advanced Features

Presigned URLs

Generate temporary access URLs (default: 1 hour):

CODEBLOCK10

List uploaded videos

CODEBLOCK11

Delete files from S3

CODEBLOCK12

Environment Variables

• - YOUTUBE_S3_CONFIG: Path to config file (default: ~/.youtube-s3-uploader.yml)
• INLINECODE5: Override default bucket
• INLINECODE6: Keep local files (default: false)
• INLINECODE8: Enable debug logging

Security Best Practices

1. 1. Use IAM roles when possible instead of long-term credentials
2. Set short expiration for presigned URLs (minutes, not days)
3. Enable bucket versioning for accidental deletion protection
4. Configure lifecycle rules to automatically delete old files
5. Use bucket policies to restrict access by IP or referrer

Troubleshooting

Common Issues

1. 1. "Invalid credentials": Check your Access Key ID and Secret Access Key
2. "Bucket does not exist": Create the bucket in your S3 provider's dashboard
3. "Access denied": Verify bucket policies and IAM permissions
4. "SSL certificate error": For self-signed certificates, use HTTP or add certificate exception
5. "Upload timeout": Large files may need multipart upload - use the fixed version
6. "Memory overflow": Use the fixed version with chunked reading
7. "Large file upload fails": Use youtube-to-s3-fixed.js for files >50MB

Fixed Version for Large Files

For large video files (>50MB), use the fixed version that implements S3 Multipart Upload:

CODEBLOCK13

The fixed version:

• - Uses S3 Multipart Upload for files >50MB
• Implements chunked reading to avoid memory overflow
• Includes retry mechanism for failed uploads
• Shows real-time progress and speed
• Automatically selects best method based on file size

Debug Mode

Enable debug logging to see detailed information:

CODEBLOCK14

License

MIT-0 - Free to use, modify, and redistribute. No attribution required.

Credits

Created by 西米露 (Simeilu) - A complete YouTube to S3 workflow for personal media storage.