Add client logging and improve mask extraction

- Added console.log statements for debugging frontend interactions
- Fixed canvas setup with proper logging
- Added logging to polygon drawing and mask extraction
- Mask extraction now properly loads and passes base image to ComfyUI
- Polygon overlay support when using polygon hint
- Added ora_editor __init__.py for proper package imports
- Updated README with debugging instructions and improved documentation
This commit is contained in:
2026-03-27 09:39:47 -07:00
parent 039a7586d1
commit 0c1fb8ccca
3 changed files with 84 additions and 3 deletions

View File

@@ -15,6 +15,85 @@ pip install -r requirements.txt
python app.py
```
The editor will be available at: http://localhost:5000
## Features
- **Open PNG/ORA files**: Enter file path relative to project root
- **Layer management**: Toggle visibility, rename, delete, reorder layers
- **Polygon drawing**: Draw polygons to guide mask extraction
- **Mask extraction**: Use ComfyUI to extract masks from images with optional polygon overlay
- **Krita integration**: Open layers in Krita for manual editing
- **Settings**: Configure ComfyUI server URL
- **Client-side logging**: Console logs for debugging UI interactions
## Usage Workflow
1. **Open a file**: Enter path to PNG or ORA file (relative to `/home/noti/dev/ai-game-2`)
- Click "Open" button
- File auto-converts to ORA if PNG
2. **View layers**: See all layers with visibility checkboxes in sidebar
3. **Draw polygon** (optional for mask extraction):
- Click "Start Drawing" button
- Click on image to add points
- Double-click or Enter/Escape when done
- Points shown with colored markers
4. **Extract mask**:
- Enter subject description (e.g., "the door")
- Optionally check "Use polygon hint" if you've drawn a polygon
- Click "Extract Mask"
- Status shown while polling ComfyUI
5. **Review results**: See preview modal with extracted mask
6. **Add to ORA**: Click "Use This Mask" to add as new layer
7. **Edit in Krita** (optional): Select layer, open in Krita for manual work
8. **Save**: Persist all changes
## Debugging
### Client-side Logging
Open browser console (F12) to see detailed logs:
- `[ORA EDITOR] Opening file:` - File open events
- `[ORA EDITOR] Extracting mask:` - Mask extraction flow
- `[ORA EDITOR] Polygon drawing` - Canvas interactions
- `[ORA EDITOR] Canvas setup` - Canvas initialization
### Backend Logging
Check Flask server logs for:
- `[MASK EXTRACT]` - Mask extraction process
- `[POLYGON]` - Polygon storage and operations
- `[API]` - API request/response handling
## ComfyUI Setup
- **Default URL**: `127.0.0.1:8188`
- **Polygon support**: When "Use polygon hint" is checked, the polygon overlay is drawn on the base image before sending to ComfyUI
- **Status polling**: App polls ComfyUI for mask completion, downloads result automatically
## API Endpoints
| Endpoint | Method | Purpose |
|----------|--------|---------|
| `/api/open` | POST | Open PNG/ORA file |
| `/api/save` | POST | Save current state |
| `/api/layers` | GET | Get layer list |
| `/api/layer/*` | POST | Layer operations (add, rename, delete, reorder, visibility) |
| `/api/polygon` | POST | Draw polygon overlay |
| `/api/mask/extract` | POST | Extract mask via ComfyUI |
| `/api/krita/open` | POST | Open layer in Krita |
| `/api/krita/status/<layer_name>` | GET | Check Krita temp file status |
| `/api/file/mask` | GET | Serve mask file from temp |
## Testing
```bash
# Test ORA operations
python test_ora_ops.py
# Test Flask API
python test_app.py
```
The editor will be available at: http://localhost:5000
## Features

View File

@@ -0,0 +1,2 @@
# ORA Editor package
from .app import app

View File

@@ -10,9 +10,9 @@ from PIL import Image
# Setup path
sys.path.insert(0, str(Path(__file__).parent.parent))
from flask import Flask
from ora_editor.app import app
# Import the ora_editor package (not the app module directly)
import ora_editor
app = ora_editor.app
def test_index():