Classifier-free guidance with adaptive scaling

2025
book section
conference proceedings
dc.abstract.enClassifier-free guidance (CFG) is an essential mechanism in contemporary text-driven diffusion models. In practice, in controlling the impact of guidance we can see the trade-off between the quality of the generated images and correspondence to the prompt. When we use strong guidance, generated images fit the conditioned text perfectly but at the cost of their quality. Dually, we can use small guidance to generate high-quality results, but the generated images do not suit our prompt. In this paper, we present β-CFG (β-adaptive scaling in Classifier-Free Guidance), which controls the impact of guidance during generation to solve the above trade-off. First, β-CFG stabilizes the effects of guiding by gradient-based adaptive normalization. Second, β-CFG uses the family of single-modal (β-distribution), time-dependent curves to dynamically adapt the trade-off between prompt matching and the quality of samples during the diffusion denoising process. Our model obtained better FID scores, maintaining the text-to-image CLIP similarity scores at a level similar to that of the reference CFG.
dc.affiliationWydział Matematyki i Informatyki : Instytut Informatyki i Matematyki Komputerowej
dc.affiliationSzkoła Doktorska Nauk Ścisłych i Przyrodniczych
dc.conference28th European Conference on Artificial Intelligence
dc.conference.cityBolonia
dc.conference.countryWłochy
dc.conference.datefinish2025-10-30
dc.conference.datestart2025-10-25
dc.conference.seriesEuropean Conference on Artificial Intelligence
dc.conference.seriesshortcutECAI
dc.conference.shortcutECAI 2025
dc.conference.weblinkhttps://ecai2025.org/
dc.contributor.authorMalarz, Dawid
dc.contributor.authorKasymov, Artur - 405187
dc.contributor.authorZięba, Maciej
dc.contributor.authorTabor, Jacek - 132362
dc.contributor.authorSpurek, Przemysław - 135993
dc.contributor.editorLynce, Inês
dc.contributor.editorMurano, Nello
dc.contributor.editorVallati, Mauro
dc.contributor.editorVillata, Serena
dc.contributor.editorChesani, Federico
dc.contributor.editorMilano, Michela
dc.contributor.editorOmicini, Andrea
dc.contributor.editorDastani, Mehdi
dc.date.accession2025-10-29
dc.date.accessioned2025-10-29T07:32:59Z
dc.date.available2025-10-29T07:32:59Z
dc.date.createdat2025-10-28T09:46:53Zen
dc.date.issued2025
dc.date.openaccess0
dc.description.accesstimew momencie opublikowania
dc.description.conftypeinternational
dc.description.physical435-442
dc.description.seriesFrontiers in Artificial Intelligence and Applications
dc.description.seriesnumber413
dc.description.versionostateczna wersja wydawcy
dc.identifier.doi10.3233/FAIA250836
dc.identifier.eisbn978-1-64368-631-8
dc.identifier.projectDRC AI
dc.identifier.serieseissn1879-8314
dc.identifier.seriesissn0922-6389
dc.identifier.urihttps://ruj.uj.edu.pl/handle/item/564203
dc.identifier.weblinkhttps://ebooks.iospress.nl/volumearticle/75772
dc.languageeng
dc.language.containereng
dc.placeAmsterdam
dc.publisherIOS Press
dc.publisher.ministerialIOS Press
dc.rightsUdzielam licencji. Uznanie autorstwa - Użycie niekomercyjne 4.0 Międzynarodowa
dc.rights.licenceCC-BY-NC
dc.rights.urihttp://creativecommons.org/licenses/by-nc/4.0/legalcode.pl
dc.share.typeinne
dc.source.integratorfalse
dc.subtypeConferenceProceedings
dc.titleClassifier-free guidance with adaptive scaling
dc.title.container28th European Conference on Artificial Intelligence, 25-30 October 2025, Bologna, Italy : Including 14th Conference on Prestigious Applications of Intelligent Systems (PAIS 2025)
dc.typeBookSection
dspace.entity.typePublicationen
dc.abstract.en
Classifier-free guidance (CFG) is an essential mechanism in contemporary text-driven diffusion models. In practice, in controlling the impact of guidance we can see the trade-off between the quality of the generated images and correspondence to the prompt. When we use strong guidance, generated images fit the conditioned text perfectly but at the cost of their quality. Dually, we can use small guidance to generate high-quality results, but the generated images do not suit our prompt. In this paper, we present β-CFG (β-adaptive scaling in Classifier-Free Guidance), which controls the impact of guidance during generation to solve the above trade-off. First, β-CFG stabilizes the effects of guiding by gradient-based adaptive normalization. Second, β-CFG uses the family of single-modal (β-distribution), time-dependent curves to dynamically adapt the trade-off between prompt matching and the quality of samples during the diffusion denoising process. Our model obtained better FID scores, maintaining the text-to-image CLIP similarity scores at a level similar to that of the reference CFG.
dc.affiliation
Wydział Matematyki i Informatyki : Instytut Informatyki i Matematyki Komputerowej
dc.affiliation
Szkoła Doktorska Nauk Ścisłych i Przyrodniczych
dc.conference
28th European Conference on Artificial Intelligence
dc.conference.city
Bolonia
dc.conference.country
Włochy
dc.conference.datefinish
2025-10-30
dc.conference.datestart
2025-10-25
dc.conference.series
European Conference on Artificial Intelligence
dc.conference.seriesshortcut
ECAI
dc.conference.shortcut
ECAI 2025
dc.conference.weblink
https://ecai2025.org/
dc.contributor.author
Malarz, Dawid
dc.contributor.author
Kasymov, Artur - 405187
dc.contributor.author
Zięba, Maciej
dc.contributor.author
Tabor, Jacek - 132362
dc.contributor.author
Spurek, Przemysław - 135993
dc.contributor.editor
Lynce, Inês
dc.contributor.editor
Murano, Nello
dc.contributor.editor
Vallati, Mauro
dc.contributor.editor
Villata, Serena
dc.contributor.editor
Chesani, Federico
dc.contributor.editor
Milano, Michela
dc.contributor.editor
Omicini, Andrea
dc.contributor.editor
Dastani, Mehdi
dc.date.accession
2025-10-29
dc.date.accessioned
2025-10-29T07:32:59Z
dc.date.available
2025-10-29T07:32:59Z
dc.date.createdaten
2025-10-28T09:46:53Z
dc.date.issued
2025
dc.date.openaccess
0
dc.description.accesstime
w momencie opublikowania
dc.description.conftype
international
dc.description.physical
435-442
dc.description.series
Frontiers in Artificial Intelligence and Applications
dc.description.seriesnumber
413
dc.description.version
ostateczna wersja wydawcy
dc.identifier.doi
10.3233/FAIA250836
dc.identifier.eisbn
978-1-64368-631-8
dc.identifier.project
DRC AI
dc.identifier.serieseissn
1879-8314
dc.identifier.seriesissn
0922-6389
dc.identifier.uri
https://ruj.uj.edu.pl/handle/item/564203
dc.identifier.weblink
https://ebooks.iospress.nl/volumearticle/75772
dc.language
eng
dc.language.container
eng
dc.place
Amsterdam
dc.publisher
IOS Press
dc.publisher.ministerial
IOS Press
dc.rights
Udzielam licencji. Uznanie autorstwa - Użycie niekomercyjne 4.0 Międzynarodowa
dc.rights.licence
CC-BY-NC
dc.rights.uri
http://creativecommons.org/licenses/by-nc/4.0/legalcode.pl
dc.share.type
inne
dc.source.integrator
false
dc.subtype
ConferenceProceedings
dc.title
Classifier-free guidance with adaptive scaling
dc.title.container
28th European Conference on Artificial Intelligence, 25-30 October 2025, Bologna, Italy : Including 14th Conference on Prestigious Applications of Intelligent Systems (PAIS 2025)
dc.type
BookSection
dspace.entity.typeen
Publication

* The migration of download and view statistics prior to the date of April 8, 2024 is in progress.

Views
70
Views per month
Views per city
Frankfurt am Main
7
Niepołomice
5
Krakow
4
Düsseldorf
2
Poznan
2
Warsaw
2
Wroclaw
2
Athens
1
Austin
1
Buffalo
1
Downloads
kasymov_et-al_classifier-free_guidance_with_adaptive_scaling_2025.pdf
173