github/ai-toolkit
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

Add support for ACE-Step 1.5 and ACE-Step 1.5 XL. Also added dataset captioning through the UI. (#785)

Browse Source 
* Base ace step 1.5 xl added. Generating, still wip on training and ui

* Base training code done

* Fix some issues with caching text embeddings. Update sample cards to show audio

* Fix issue with quantizing ace step

* Add album artwork to samples with waveform.

* Cleanup logs

* Add album art endpoint to speed up album art loading

* Made an make video with artwork script

* Make ui handle basic audio models. Make multi line adjustments to the editor and better syntax hilighting.

* Add prompt tagging system for special tagged models.

* prompt tagging processing for ui working.

* Moved default samples to a special file so we can add more when needed and they can be adjusted for a specific model

* Add a captioner job with music captioner that is prepped for use with the ui

* Add basit ui setup for captioning modal and handeling captioning jobs

* Starting captioning job from ui working. Still better management for it.

* Better filtering of job options in the job view for captioning jobs

* Added qwen3 vl as a captioner for images

* Have an indicator when a dataset is being captioned.

* Adjust the way caption jobs look in the queue

* Fix a few issues. Adjust defaults.

* Version bump

* Added ace step to the readme.
This commit is contained in:
Jaret Burkett
2026-04-09 15:02:03 -06:00
committed by GitHub
parent 9ca58e9aa2
commit 78cf049c29
54 changed files with 5589 additions and 536 deletions
Download Patch File Download Diff File Expand all files Collapse all files

30
ui/src/types.ts
View File

@@ -252,6 +252,36 @@ export interface JobConfig {
meta: MetaConfig;
}
export interface CaptionProcessConfig {
type: string;
sqlite_db_path?: string;
device: string;
caption: {
model_name_or_path: string;
model_name_or_path2?: string;
dtype: string;
quantize: boolean;
qtype: string;
low_vram: boolean;
extensions: string[];
path_to_caption: string;
recaption: boolean;
caption_prompt?: string;
max_res?: number;
max_new_tokens?: number;
}
}
export interface CaptionConfigObject {
name: string;
process: CaptionProcessConfig[];
}
export interface CaptionJobConfig {
job: string;
config: CaptionConfigObject;
}
export interface ConfigDoc {
title: string | React.ReactNode;
description: React.ReactNode;