Where is the signal in tokenization space?

Where is the signal in tokenization space? (bibtex)

by Renato Lui Geh, Honghua Zhang, Kareem Ahmed, Benjie Wang and Guy Van den Broeck

Reference:

Renato Lui Geh, Honghua Zhang, Kareem Ahmed, Benjie Wang and Guy Van den Broeck. Where is the signal in tokenization space?, In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024.

Bibtex Entry:

@inproceedings{GehEMNLP24,
  author    = {Geh, Renato Lui and Zhang, Honghua and Ahmed, Kareem and Wang, Benjie and Van den Broeck, Guy},
  title     = {Where is the signal in tokenization space?},
  booktitle = {Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP)},
  url       = "https://starai.cs.ucla.edu/papers/GehEMNLP24.pdf",
  month     = {nov},
  year      = {2024},
  keywords  = {conference,selective},
  annotation = "(Oral full presentation, acceptance rate 198/6105 = 3.24\%)",
}

PDF Preview: