Skip navigation
Please use this identifier to cite or link to this item: http://arks.princeton.edu/ark:/88435/dsp01gt54kr077
Title: Word Embedding Measures of Bias in Automatic Summarization
Authors: Jiang, May
Advisors: Fellbaum, Christiane
Department: Computer Science
Class Year: 2020
Abstract: With the rapidly growing volume of textual data and the accompanying development of machine learning methods to learn from that data, the fact that such data are infused with human biases—and that such biases propagate to these models and through them into downstream applications—has become ever more important. Word embeddings, in particular, have been shown to inherit biases and have consequently been used for quantifying bias in text corpora. The objective of this work is to examine word embedding measures of bias, probing into the factors that affect their results and, in light of these characteristics, the reliability and applicability of these metrics. Investigating these measures in application, we find that factors such as length and gender ratios within a corpus can significantly influence or distort the bias measured. With this in mind, we analyze bias in summarization, studying how bias in a text propagates to its summary to gain insight into the bias carried in and from text, and find that controlled for length, summaries—the articles in concentrated form—are also more concentrated in measurable bias. Finally, we extend our analysis and leverage word embeddings to encapsulate broader aspects of bias and illuminate more nuances in text, introducing novel approaches to incorporate sentiment in bias measurement and to effectively detect and extract coherent personality stereotype clusters and their biases.
URI: http://arks.princeton.edu/ark:/88435/dsp01gt54kr077
Type of Material: Princeton University Senior Theses
Language: en
Appears in Collections:Computer Science, 1987-2023

Files in This Item:
File Description SizeFormat 
JIANG-MAY-THESIS.pdf666.66 kBAdobe PDF    Request a copy


Items in Dataspace are protected by copyright, with all rights reserved, unless otherwise indicated.