Please use this identifier to cite or link to this item:
http://arks.princeton.edu/ark:/88435/dsp013b591c85c
Title: | Consistency Correction through Diffusion-based Edits |
Authors: | Gupta, Aatmik |
Advisors: | Chen, Danqi |
Department: | Computer Science |
Class Year: | 2023 |
Abstract: | Consistency is a crucial aspect of high-quality text generation. In this paper, we propose and evaluate several approaches to improve consistency in generated text, focusing on the task of rewriting short stories to maintain consistency while making minimal changes. We modify the SSD-LM diffusion-based architecture with the addition of a consistency classifier, and incorporate a minimum-edit loss function to encourage minimal edits. We compare our methods against several baseline models and observe significant improvements in terms of perplexity and consistency. However, we also identify limitations in our evaluation metrics and note that larger autoregressive models do outperform our model. This work provides a foundation for future research on consistency correction in text generation tasks. |
URI: | http://arks.princeton.edu/ark:/88435/dsp013b591c85c |
Type of Material: | Princeton University Senior Theses |
Language: | en |
Appears in Collections: | Computer Science, 1987-2024 |
Files in This Item:
File | Size | Format | |
---|---|---|---|
GUPTA-AATMIK-THESIS.pdf | 830.64 kB | Adobe PDF | Request a copy |
Items in Dataspace are protected by copyright, with all rights reserved, unless otherwise indicated.