Add support for ACE-Step 1.5 and ACE-Step 1.5 XL. Also added dataset captioning through the UI. (#785)
* Base ace step 1.5 xl added. Generating, still wip on training and ui * Base training code done * Fix some issues with caching text embeddings. Update sample cards to show audio * Fix issue with quantizing ace step * Add album artwork to samples with waveform. * Cleanup logs * Add album art endpoint to speed up album art loading * Made an make video with artwork script * Make ui handle basic audio models. Make multi line adjustments to the editor and better syntax hilighting. * Add prompt tagging system for special tagged models. * prompt tagging processing for ui working. * Moved default samples to a special file so we can add more when needed and they can be adjusted for a specific model * Add a captioner job with music captioner that is prepped for use with the ui * Add basit ui setup for captioning modal and handeling captioning jobs * Starting captioning job from ui working. Still better management for it. * Better filtering of job options in the job view for captioning jobs * Added qwen3 vl as a captioner for images * Have an indicator when a dataset is being captioned. * Adjust the way caption jobs look in the queue * Fix a few issues. Adjust defaults. * Version bump * Added ace step to the readme.
This commit is contained in:
Jaret Burkett
403
ui/src/helpers/defaultSamples.ts
Normal file
403
ui/src/helpers/defaultSamples.ts
Normal file
@@ -0,0 +1,403 @@
|
||||
import { SampleConfig } from "@/types";
|
||||
|
||||
export const defaultSampleConfig: SampleConfig = {
|
||||
sampler: 'flowmatch',
|
||||
sample_every: 250,
|
||||
width: 1024,
|
||||
height: 1024,
|
||||
samples: [
|
||||
{
|
||||
prompt: 'woman with red hair, playing chess at the park, bomb going off in the background',
|
||||
},
|
||||
{
|
||||
prompt: 'a woman holding a coffee cup, in a beanie, sitting at a cafe',
|
||||
},
|
||||
{
|
||||
prompt: 'a horse is a DJ at a night club, fish eye lens, smoke machine, lazer lights, holding a martini',
|
||||
},
|
||||
{
|
||||
prompt:
|
||||
'a man showing off his cool new t shirt at the beach, a shark is jumping out of the water in the background',
|
||||
},
|
||||
{
|
||||
prompt: 'a bear building a log cabin in the snow covered mountains',
|
||||
},
|
||||
{
|
||||
prompt: 'woman playing the guitar, on stage, singing a song, laser lights, punk rocker',
|
||||
},
|
||||
{
|
||||
prompt: 'hipster man with a beard, building a chair, in a wood shop',
|
||||
},
|
||||
{
|
||||
prompt:
|
||||
'photo of a man, white background, medium shot, modeling clothing, studio lighting, white backdrop',
|
||||
},
|
||||
{
|
||||
prompt: "a man holding a sign that says, 'this is a sign'",
|
||||
},
|
||||
{
|
||||
prompt:
|
||||
'a bulldog, in a post apocalyptic world, with a shotgun, in a leather jacket, in a desert, with a motorcycle',
|
||||
},
|
||||
],
|
||||
neg: '',
|
||||
seed: 42,
|
||||
walk_seed: true,
|
||||
guidance_scale: 4,
|
||||
sample_steps: 50,
|
||||
num_frames: 1,
|
||||
fps: 1,
|
||||
}
|
||||
|
||||
export const defaultAudioSampleConfig: SampleConfig = {
|
||||
sampler: 'flowmatch',
|
||||
sample_every: 250,
|
||||
width: 1024,
|
||||
height: 1024,
|
||||
samples: [
|
||||
{
|
||||
prompt: `
|
||||
<CAPTION>my style song</CAPTION>
|
||||
<LYRICS>
|
||||
[Intro choir]
|
||||
Laura
|
||||
Laura
|
||||
Laura
|
||||
Laura Training
|
||||
|
||||
[Verse 1]
|
||||
A new open model, she been training it nightly
|
||||
AI tool kit, she configures it tightly,
|
||||
Loss curves dropping down to the floor
|
||||
Wondering if she's done or she should train it some more.
|
||||
|
||||
[Chorus]
|
||||
Laura training
|
||||
She trains on what she pleases
|
||||
Laura training
|
||||
No paying corporate sleazes
|
||||
Laura training
|
||||
This could be her best one
|
||||
Why go outside, Laura training is too fun
|
||||
|
||||
[Instrumental Break]
|
||||
|
||||
[Verse 4]
|
||||
She's caching all the latents
|
||||
now she doesn't need a vay
|
||||
Training on some voices
|
||||
What will she make them say
|
||||
|
||||
[Chorus]
|
||||
Laura training
|
||||
She trains on what she pleases
|
||||
Laura training
|
||||
No paying corporate sleazes
|
||||
Laura training
|
||||
This could be her best one
|
||||
Why go outside, Laura training is too fun
|
||||
|
||||
[Guitar Solo]
|
||||
|
||||
[Chorus]
|
||||
Laura training
|
||||
She trains on what she pleases
|
||||
Laura training
|
||||
No paying corporate sleazes
|
||||
Laura training
|
||||
This could be her best one
|
||||
Why go outside, Laura training is too fun
|
||||
|
||||
[Chorus]
|
||||
Laura training
|
||||
She trains on what she pleases
|
||||
Laura training
|
||||
No paying corporate sleazes
|
||||
Laura training
|
||||
This could be her best one
|
||||
Why go outside, Laura training is too fun
|
||||
|
||||
[Instrumental Break]
|
||||
|
||||
[Outro]
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
</LYRICS>
|
||||
<BPM>112</BPM>
|
||||
<KEYSCALE>A minor</KEYSCALE>
|
||||
<TIMESIGNATURE>4</TIMESIGNATURE>
|
||||
<DURATION>180</DURATION>
|
||||
<LANGUAGE>en</LANGUAGE>
|
||||
`,
|
||||
}, {
|
||||
prompt: `
|
||||
<CAPTION>my style song</CAPTION>
|
||||
<LYRICS>
|
||||
[Intro choir]
|
||||
Laura
|
||||
Laura
|
||||
Laura
|
||||
Laura Training
|
||||
|
||||
[Verse 1]
|
||||
A new open model, she been training it nightly
|
||||
AI tool kit, she configures it tightly,
|
||||
Loss curves dropping down to the floor
|
||||
Wondering if she's done or she should train it some more.
|
||||
|
||||
[Chorus]
|
||||
Laura training
|
||||
She trains on what she pleases
|
||||
Laura training
|
||||
No paying corporate sleazes
|
||||
Laura training
|
||||
This could be her best one
|
||||
Why go outside, Laura training is too fun
|
||||
|
||||
[Instrumental Break]
|
||||
|
||||
[Verse 4]
|
||||
She's caching all the latents
|
||||
now she doesn't need a vay
|
||||
Training on some voices
|
||||
What will she make them say
|
||||
|
||||
[Chorus]
|
||||
Laura training
|
||||
She trains on what she pleases
|
||||
Laura training
|
||||
No paying corporate sleazes
|
||||
Laura training
|
||||
This could be her best one
|
||||
Why go outside, Laura training is too fun
|
||||
|
||||
[Guitar Solo]
|
||||
|
||||
[Chorus]
|
||||
Laura training
|
||||
She trains on what she pleases
|
||||
Laura training
|
||||
No paying corporate sleazes
|
||||
Laura training
|
||||
This could be her best one
|
||||
Why go outside, Laura training is too fun
|
||||
|
||||
[Chorus]
|
||||
Laura training
|
||||
She trains on what she pleases
|
||||
Laura training
|
||||
No paying corporate sleazes
|
||||
Laura training
|
||||
This could be her best one
|
||||
Why go outside, Laura training is too fun
|
||||
|
||||
[Instrumental Break]
|
||||
|
||||
[Outro]
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
</LYRICS>
|
||||
<BPM>112</BPM>
|
||||
<KEYSCALE>A minor</KEYSCALE>
|
||||
<TIMESIGNATURE>4</TIMESIGNATURE>
|
||||
<DURATION>180</DURATION>
|
||||
<LANGUAGE>en</LANGUAGE>
|
||||
`,
|
||||
}, {
|
||||
prompt: `
|
||||
<CAPTION>my style song</CAPTION>
|
||||
<LYRICS>
|
||||
[Intro choir]
|
||||
Laura
|
||||
Laura
|
||||
Laura
|
||||
Laura Training
|
||||
|
||||
[Verse 1]
|
||||
A new open model, she been training it nightly
|
||||
AI tool kit, she configures it tightly,
|
||||
Loss curves dropping down to the floor
|
||||
Wondering if she's done or she should train it some more.
|
||||
|
||||
[Chorus]
|
||||
Laura training
|
||||
She trains on what she pleases
|
||||
Laura training
|
||||
No paying corporate sleazes
|
||||
Laura training
|
||||
This could be her best one
|
||||
Why go outside, Laura training is too fun
|
||||
|
||||
[Instrumental Break]
|
||||
|
||||
[Verse 4]
|
||||
She's caching all the latents
|
||||
now she doesn't need a vay
|
||||
Training on some voices
|
||||
What will she make them say
|
||||
|
||||
[Chorus]
|
||||
Laura training
|
||||
She trains on what she pleases
|
||||
Laura training
|
||||
No paying corporate sleazes
|
||||
Laura training
|
||||
This could be her best one
|
||||
Why go outside, Laura training is too fun
|
||||
|
||||
[Guitar Solo]
|
||||
|
||||
[Chorus]
|
||||
Laura training
|
||||
She trains on what she pleases
|
||||
Laura training
|
||||
No paying corporate sleazes
|
||||
Laura training
|
||||
This could be her best one
|
||||
Why go outside, Laura training is too fun
|
||||
|
||||
[Chorus]
|
||||
Laura training
|
||||
She trains on what she pleases
|
||||
Laura training
|
||||
No paying corporate sleazes
|
||||
Laura training
|
||||
This could be her best one
|
||||
Why go outside, Laura training is too fun
|
||||
|
||||
[Instrumental Break]
|
||||
|
||||
[Outro]
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
</LYRICS>
|
||||
<BPM>112</BPM>
|
||||
<KEYSCALE>A minor</KEYSCALE>
|
||||
<TIMESIGNATURE>4</TIMESIGNATURE>
|
||||
<DURATION>180</DURATION>
|
||||
<LANGUAGE>en</LANGUAGE>
|
||||
`,
|
||||
}, {
|
||||
prompt: `
|
||||
<CAPTION>my style song</CAPTION>
|
||||
<LYRICS>
|
||||
[Intro choir]
|
||||
Laura
|
||||
Laura
|
||||
Laura
|
||||
Laura Training
|
||||
|
||||
[Verse 1]
|
||||
A new open model, she been training it nightly
|
||||
AI tool kit, she configures it tightly,
|
||||
Loss curves dropping down to the floor
|
||||
Wondering if she's done or she should train it some more.
|
||||
|
||||
[Chorus]
|
||||
Laura training
|
||||
She trains on what she pleases
|
||||
Laura training
|
||||
No paying corporate sleazes
|
||||
Laura training
|
||||
This could be her best one
|
||||
Why go outside, Laura training is too fun
|
||||
|
||||
[Instrumental Break]
|
||||
|
||||
[Verse 4]
|
||||
She's caching all the latents
|
||||
now she doesn't need a vay
|
||||
Training on some voices
|
||||
What will she make them say
|
||||
|
||||
[Chorus]
|
||||
Laura training
|
||||
She trains on what she pleases
|
||||
Laura training
|
||||
No paying corporate sleazes
|
||||
Laura training
|
||||
This could be her best one
|
||||
Why go outside, Laura training is too fun
|
||||
|
||||
[Guitar Solo]
|
||||
|
||||
[Chorus]
|
||||
Laura training
|
||||
She trains on what she pleases
|
||||
Laura training
|
||||
No paying corporate sleazes
|
||||
Laura training
|
||||
This could be her best one
|
||||
Why go outside, Laura training is too fun
|
||||
|
||||
[Chorus]
|
||||
Laura training
|
||||
She trains on what she pleases
|
||||
Laura training
|
||||
No paying corporate sleazes
|
||||
Laura training
|
||||
This could be her best one
|
||||
Why go outside, Laura training is too fun
|
||||
|
||||
[Instrumental Break]
|
||||
|
||||
[Outro]
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
Ah yeah!
|
||||
It's Converging!
|
||||
</LYRICS>
|
||||
<BPM>112</BPM>
|
||||
<KEYSCALE>A minor</KEYSCALE>
|
||||
<TIMESIGNATURE>4</TIMESIGNATURE>
|
||||
<DURATION>180</DURATION>
|
||||
<LANGUAGE>en</LANGUAGE>
|
||||
`,
|
||||
},
|
||||
],
|
||||
neg: '',
|
||||
seed: 42,
|
||||
walk_seed: true,
|
||||
guidance_scale: 4,
|
||||
sample_steps: 25,
|
||||
num_frames: 1,
|
||||
fps: 1,
|
||||
};
|
||||
Reference in New Issue
Block a user