2024
Evaluating the Zero-shot Robustness of Instruction-tuned Language Models
Jiuding Sun, Chantal Shaib and Byron C. Wallace
LLMs Represent Contextual Tasks as Compact Function Vectors
Eric Todd, Millicent Li, Arnab Sen Sharma, Aaron Mueller, Byron C Wallace and David Bau
ICLR
pre-print
Evaluating the Factuality of Zero-shot Summarizers Across Varied Domains
Sanjana Ramprasad, Kundan Krishna, Zachary C. Lipton and Byron C. Wallace
EACL
pre-print
Leveraging ChatGPT in Pharmacovigilance Event Extraction: An Empirical Study
Zhaoyue Sun, Gabriele Pergola, Byron C Wallace and Yulan He
EACL
Question answering systems for health professionals at the point of care: A systematic review
Gregory Kell, Angus Roberts, Serge Umansky, Linglong Qian, Davide Ferrari, Frank Soboczenski, Byron C Wallace, Nikhil Patel and Iain J Marshall
JAMIA
link
On-the-fly Definition Augmentation of LLMs for Biomedical NER
Monica Munnangi ~Monica_Munnangi1 , Sergey Feldman, Byron C Wallace, Silvio Amir, Tom Hope and Aakanksha Naik
NAACL
pre-print
Towards Reducing Diagnostic Errors with Interpretable Risk Prediction
Denis Jered McInerney, William Dickinson, Lucy C. Flynn, Andrea C Young, Geoffrey Young, Jan-Willem van de Meent and Byron C Wallace
NAACL
pre-print
Retrieving Evidence from EHRs with LLMs: Possibilities and Challenges
Hiba Ahsan, Denis Jered McInerney, Jisoo Kim, Christopher A Potter, Geoffrey Young, Silvio Amir, and Byron C Wallace
ACM CHIL
pre-print
Infolossqa: Characterizing and recovering information loss in text simplification
Jan Trienes, Sebastian Joseph, Jörg Schlötterer, Christin Seifert, Kyle Lo, Wei Xu, Byron C Wallace, and Junyi Jessy Li
ACL
pre-print
FACTPICO: Factuality Evaluation for Plain Language Summarization of Medical Evidence
Sebastian Antony Joseph, Lily Chen, Jan Trienes, Hannah Louisa Göke, Monika Coers, Wei Xu, Byron C Wallace, and Junyi Jessy Li
ACL
pre-print
Open (Clinical) LLMs are Sensitive to Instruction Phrasings
Alberto Mario Ceballos-Arroyo, Monica Munnangi, Jiuding Sun, Karen Zhang, Jered McInerney, Byron C. Wallace and Silvio Amir
2023
RedHOT: A Corpus of Annotated Medical Questions, Experiences, and Claims on Social Media
Somin Wadhwa, Vivek Khetan, Silvio Amir and Byron C. Wallace
EACL (Findings)
pre-print
NapSS: Paragraph-level Medical Text Simplification via Narrative Prompting and Sentence-matching Summarization
Junru Lu, Jiazheng Li, Byron C. Wallace, Yulan He and Gabriele Pergola
EACL (Findings)
pre-print
How Many and Which Training Points Would Need to be Removed to Flip this Prediction?
Jinhan Yang, Sarthak Jain and Byron C. Wallace
EACL
pre-print
Automatically Summarizing Evidence from Clinical Trials: A Prototype Highlighting Current Challenges
Sanjana Ramprasad, Denis Jered McInerney, Iain J. Marshall and Byron C. Wallace
EACL (System Demonstrations track)
pre-print
Automated Metrics for Medical Multi-Document Summarization Disagree with Human Evaluations
Lucy Lu Wang, Yulia Otmakhova, Jay DeYoung, Thinh Hung Truong, Bailey E. Kuehl, Erin Bransom and Byron C. Wallace
ACL
pre-print
Summarizing, Simplifying, and Synthesizing Medical Evidence using GPT-3 (with Varying Success)
Chantal Shaib, Millicent Liaw Li, Sebastian A. Joseph, Iain Marshall, Junyi Jessy Li and Byron C. Wallace
ACL
pre-print
Revisiting Relation Extraction in the era of Large Language Models
Somin Wadhwa, Silvio Amir and Byron C. Wallace
ACL
pre-print
CHiLL: Zero-shot Custom Interpretable Feature Extraction from Clinical Notes with Large Language Models
Denis Jered McInerney, Geoffrey Young, Jan-Willem van de Meent, and Byron C. Wallace
EMNLP (Findings)
pre-print
Appraising the Potential Uses and Harms of LLMs for Medical Systematic Reviews
Hye Sun Yun, Iain J. Marshall, Thomas Trikalinos and Byron C. Wallace
EMNLP
pre-print
USB: A Unified Summarization Benchmark Across Tasks and Domains
Kundan Krishna, Prakhar Gupta, Sanjana Ramprasad, Byron C. Wallace, Jeffrey P. Bigham and Zachary C. Lipton
EMNLP (Findings)
pre-print
Multilingual Simplification of Medical Texts
Sebastian Joseph, Kathryn Kazanas, Keziah Reina, Vishnesh J. Ramanathan, Wei Xu, Byron C. Wallace and Junyi Jessy Li
EMNLP
pre-print
Anticipating Subsequent Tokens from a Single Hidden State
Koyena Pal, Jiuding Sun, Andrew Yuan, Byron C. Wallace and David Bau
CoNLL
2022
Combining Feature and Instance Attribution to Detect Artifacts
Pouya Pezeshkpour, Sarthak Jain, Sameer Singh and Byron C. Wallace
ACL (Findings)
pre-print
Evaluating Factuality in Text Simplification
Ashwin Devaraj, William Berkeley Sheffield, Byron C Wallace and Junyi Jessy Li
ACL
Outstanding Paper recipient
pre-print
link
Accuracy and Efficiency of Machine Learning–Assisted Risk-of-Bias Assessments in “Real-World” Systematic Reviews
Anneliese Arno, James Thomas, Byron C. Wallace, Iain J. Marshall, Joanne E. McKenzie, and Julian H. Elliott
Annals of Internal Medicine
link
In a pilot study, automated real-time systematic review updates were feasible, accurate, and work-saving
Iain J Marshall, Thomas A Trikalinos, Frank Soboczenski, Hye Sun Yun, Gregory Kell, Rachel Marshall, and Byron C Wallace
Journal of Clinical Epidemiology
link
Self-repetition in abstractive neural summarizers
Nikita Salkar, Thomas Trikalinos, Byron C. Wallace, and Ani Nenkova
AACL
pre-print
Influence functions for sequence tagging models
Sarthak Jain, Varun Manjunatha, Byron C. Wallace, and Ani Nenkova
EMNLP (Findings)
pre-print
Phee: A dataset for pharmacovigilance event extraction from text
Zhaoyue Sun, Jiazheng Li, Gabriele Pergola, Byron C. Wallace, Bino John, Nigel Greene, Joseph Kim, and Yulan He
EMNLP
pre-print
That’s the wrong lung! evaluating and improving the interpretability of unsupervised multimodal encoders for medical data
Jered McInerney, Geoffrey Young, Jan-Willem van de Meent, and Byron C. Wallace
EMNLP
pre-print
2021
Interpretability Analysis for Named Entity Recognition to Understand System Predictions and How They Can Improve
Oshin Agarwal, Yinfei Yang, Byron C. Wallace, and Ani Nenkova
Computational Linguistics
pre-print
link
Generating (Factual?) Narrative Summaries of RCTs: Experiments with Neural Multi-Document Summarization
Byron C. Wallace, Sayantan Saha, Frank Soboczenski and Iain J. Marshall
AMIA Summit
pre-print
Understanding Clinical Trial Reports: Extracting Medical Entities and Their Relations
Benjamin E. Nye, Jay DeYoung, Eric Lehman, Ani Nenkova, Iain J. Marshall, and Byron C. Wallace
AMIA Summit
Best Student-led Paper Recipient
pre-print
An Empirical Comparison of Instance Attribution Methods for NLP
Pouya Pezeshkpour, Sarthak Jain, Byron C. Wallace and Sameer Singh
NAACL
pre-print
Paragraph-level Simplification of Medical Texts
Ashwin Devaraj, Iain J. Marshall, Byron C. Wallace and Junjy Jessy Li
NAACL
pre-print
Does BERT Pretrained on Clinical Notes Reveal Sensitive Data?
Eric Lehman, Sarthak Jain, Karl Pichotta, Yoav Goldberg and Byron C. Wallace
NAACL
pre-print
On the Impact of Random Seeds on the Fairness of Clinical Classifiers
Silvio Amir, Jan-Willem van de Meent and Byron C. Wallace
NAACL
pre-print
State of the evidence: a survey of global disparities in clinical trials
Iain J Marshall, Veline L'Esperance, Rachel Marshall, James Thomas, Anna Noel-Storr, Frank Soboczenski, Benjamin Nye, Ani Nenkova, Byron C. Wallace
BMJ Global Health
pre-print
link
Biomedical Interpretable Entity Representations
Diego Garcia-Olano, Yasumasa Onoe, Ioana Baldini, Joydeep Ghosh, Byron C. Wallace and Kush Varzney
ACL 2021 (Findings)
Unsupervised Data Augmentation with Naive Augmentation and without Unlabeled Data
David Lowell, Brian Howard, Zachary C. Lipton. Byron C. Wallace
EMNLP
pre-print
Disentangling Representations of Text by Masking Transformers
Xiongyi Zhang, Jan-Willem van de Meent and Byron C. Wallace
EMNLP
pre-print
2020
Semi-Automated Evidence Synthesis in Health Psychology: Current Methods and Future Prospects
Iain Marshall, Blair T. Johnson, Zigeng Wang, Sanguthevar Rajasekaran and Byron C. Wallace
Health Psychology Review
pre-print
ERASER: A Benchmark to Evaluate Rationalized NLP Models
Jay DeYoung, Sarthak Jain, Nazneen Fatema Rajani, Eric Lehman, Caiming Xiong, Richard Socher, and Byron C. Wallace
ACL 2020
pre-print
Explaining Black Box Predictions and Unveiling Data Artifacts through Influence Functions
Xiaochuang Han, Byron C. Wallace, and Yulia Tsvetkov
ACL 2020
pre-print
Learning to Faithfully Rationalize by Construction
Sarthak Jain, Sarah Wiegreffe, Yuval Pinter, and Byron C. Wallace
ACL 2020
pre-print
Trialstreamer: Mapping and Browsing Medical Evidence in Real-Time
Benjamin Nye, Ani Nenkova, Iain J. Marshall, and Byron C. Wallace
ACL 2020 (demo track)
pre-print
Evidence Inference 2.0: More Data, Better Models
Jay DeYoung and Eric Lehman and Benjamin Nye and Iain Marshall and Byron C. Wallace
BioNLP
pre-print
Semi-Automating Knowledge Base Construction for Cancer Genetics
Somin Wadhwa, Kanhua Yin, Kevin S. Hughes, and Byron C. Wallace
AKBC
link
Query-Focused EHR Summarization to Aid Imaging Diagnosis
Denis Jered McInerney, Borna Dabiri, Anne-Sophie Touret, Geoffrey Young, Jan-Willem van de Meent and Byron C. Wallace
Machine Learning for Healthcare
pre-print
Trialstreamer: a living, automatically updated database of clinical trial reports
Iain J. Marshall, Benjamin Nye, Joël Kuiper, Anna Noel-Storr, Rachel Marshall, Rory Maclean, Frank Soboczenski, Ani Nenkova, James Thomas, and Byron C. Wallace
Journal of American Medical Informatics Association
pre-print
Predicting unplanned readmissions following a hip or knee arthroplasty
Ramin Mohammadi, Sarthak Jain, Amir T Namin, Melissa Scholem Heller, Ramya Palacholla, Sagar Kamarthi, and Byron C. Wallace
JMIR Medical Informatics
link
2019
Learning to Identify Patients at Risk of Uncontrolled Hypertension Using Electronic Health Records Data
Ramin Mohammadi, Sarthak Jain, Stephen Agboola, Ramya Palacholla, Sagar Kamarthi and Byron C. Wallace
AMIA Informatics Summit
pre-print
Structured Representations for Reviews: Aspect-Based Variational Hidden Factor Models
Babak Esmaeili, Hongyi Huang, Byron C. Wallace, and Jan-Willem van de Meent
AISTATS
pre-print
link
Rapid reviews may produce different results to systematic reviews: a meta-epidemiological study
Iain J. Marshall, Rachel Marshall, Byron C. Wallace, Jon Brassey, and James Thomas
Journal of Clinical Epidemiology
link
Machine learning to help researchers evaluate biases in clinical trials: a prospective, randomized user study
Frank Soboczenski, Thomas A Trikalinos, Joël Kuiper, Randolph G Bias, Byron C Wallace and Iain J Marshall
BMC Medical Informatics and Decision Making
link
Toward systematic review automation: a practical guide to using machine learning tools in research synthesis
Iain Marshall and Byron C. Wallace
Systematic Reviews
link
2018
Living systematic reviews: 2. Combining human and machine effort
J Thomas, A Noel-Storr, I Marshall, BC Wallace, S McDonale, C Mavergames, P Glasziou, I Shemilt, A Synnot, T Turner and J Elliot
Journal of Clinical Epidemiology
link
Neural Information Retrieval: At the End of the Early Years
KD Onal, Y Zhang, IS Altingovde, M Rahman, P Karagoz, A Braylan, B Dang, HL Chang, H Kim, Q McNamara, A Angert, E Banner, V Khetan, T McDonnell, AT Nguyen, D Xu, BC Wallace, M Rijke, and M Lease
Information Retrieval
pre-print
link
Machine Learning for Identifying Randomized Controlled Trials: an evaluation and practitioner’s guide
Iain Marshall, Anna Noel Storr, Joël Kuiper, James Thomas and Byron C. Wallace
Research Synthesis Methods
link
PIVET: A scaled phenotype evidence generation framework using online medical literature
Jette Henderson, Junyuan Ke, Joyce C. Ho, Joydeep Ghosh, and Byron C. Wallace
Journal of Medical Internet Research
link
Believe it or not: Designing a Human-AI Partnership for Mixed-Initiative Fact-Checking
An T. Nguyen, Aditya Kharosekar, Saumyaa Krishnan, Siddhesh Krishnan, Elizabeth Tate, Byron C. Wallace and Matthew Lease
ACM UIST
pre-print
2017
OpenMEE: Intuitive, open-source software for meta-analysis in ecology and evolutionary biology
Byron C. Wallace, Marc J. Lajeunesse, George Dietz, Issa J. Dahabreh, Thomas A. Trikalinos, Christopher H. Schmid and Jessica Gurevitch
Methods in Ecology and Evolution
link
PheKnow–Cloud: A Tool for Evaluating High-Throughput Phenotype Candidates using Online Medical Literature
Jette Henderson, Ryan Bridges, Joyce C. Ho, Byron C. Wallace and Joydeep Ghosh
AMIA Joint Summits on Translational Science
Recipient of the 2017 Distinguished Clinical Research Informatics Paper Award
pre-print
Retrofitting Concept Vector Representations of Medical Concepts to Improve Estimates of Semantic Similarity and Relatedness
Zhiguo Yu, Byron C. Wallace, Todd Johnson and Trevor Cohen
MEDINFO
An Exploration of Crowdsourcing Citation Screening for Systematic Reviews
Michael L. Mortensen, Gaelen P. Adam, Thomas A. Trikalinos, Tim Kraska and Byron C. Wallace
Research Synthesis Methods
pre-print
Identifying diagnostic test accuracy publications using a deep model
Gaurav Singh, Iain Marshall, James Thomas and Byron C. Wallace
CLEF eHealth
2016
A Data-Driven Approach to Characterizing the (Perceived) Newsworthiness of Health Science Articles
Ye Zhang, Erin Willis, Michael Paul, Noémie Elhadad and Byron C. Wallace
JMIR Medical Informatics
link
Probabilistic Modeling for Crowdsourcing Partially-Subjective Ratings
An T. Nguyen, Matthew Halpern, Byron C. Wallace and Matthew Lease
AAAI HCOMP
pre-print
link
Evaluating Data Abstraction Assistant, anovel software application for dataabstraction during systematic reviews:protocol for a randomized controlled trial
Ian J Saldanha, Christopher H Schmid, Joseph Lau, Kay Dickersin, Jesse A Berlin, Jens Jap, Bryant T Smith, Simona Carini, Wiley Chan, Berry De Bruijn, Byron C Wallace, Susan M Hutfless, Ida Sim, M Hassan Murad, Sandra A Walsh, Elizabeth J Whamond and Tianjing Li
Systematic Reviews
Trial protocol
link
2015
Reports of the AAAI 2014 Conference Workshops
Stefano V. Albrecht, André M. S. Barreto, Darius Braziunas, David L. Buckeridge, Heriberto Cuayáhuitl, Nina Dethlefs, Markus Endres, Amir-massoud Farahmand, Mark Fox, Lutz Frommberger, Sam Ganzfried, Yolanda Gil, Sébastien Guillet, Lawrence E. Hunter, Arnav Jhala, Kristian Kersting, George Konidaris, Freddy Lecue, Sheila McIlraith, Sriraam Natarajan, Zeinab Noorian, David Poole, Rémi Ronfard, Alessandro Saffiotti, Arash Shaban-Nejad, Biplav Srivastava, Gerald Tesauro, Rosario Uceda-Sosa, Guy Van den Broeck, Martijn van Otterlo, Byron C. Wallace, Paul Weng, Jenna Wiens, Jie Zhang
Artificial Intelligence Magazine
link
2014
#CochraneTech: Technology and the Future of Systematic Reviews
Julian Elliott, Ida Sim, Jessica Thomas, Nancy Owens, Gordon Dooley, Jacob Riis, Byron Wallace, James Thomas, Anna Noel-Storr, Gabriel Rada, Caroline Struthers, Tracey Howe, Harriet MacLehose, Linn Brandt, Ilkka Kunnamo and Chris Mavergames
Cochrane Library Editorial
link
2013
Automatically Annotating Topics in Transcripts of Patient-Provider Interactions via Machine Learning
Byron C. Wallace, M. Barton Laws, Kevin Small, Ira B. Wilson and Thomas A. Trikalinos
Medical Decision Making
Highlighted in this MDM editorial.
link
2012
Toward modernizing the systematic review pipeline in genetics: efficient updating via data mining.
Byron C. Wallace, Kevin Small, Carla E. Brodley, Joseph Lau, Christopher H. Schmid, Lars Bertram, Christina M. Lill, Joshua T. Cohen and Thomas A. Trikalinos
Genetics in Medicine
link
Closing the Gap between Methodologists and End-Users: R as a Computational Back-End
Byron C. Wallace, Issa J. Dahabreh, Thomas A. Trikalinos, Joseph Lau, Paul Trow and Christopher H. Schmid
Journal of Statistical Software
link
2011
Single cell time-resolved quorum responses reveal dependence on cell density and configuration
Ragnhild D. Whitaker, Steve Pember, Byron C Wallace, Carla E Brodley and David Walt
Journal of Biological Chemistry
link
2010
Semi-automated screening of biomedical citations for systematic reviews
Byron C Wallace, Thomas A Trikalinos, Joseph Lau, Carla E Brodley and Chistopher H Schmid
BMC Bioinformatics
link
2009
Meta-Analyst: software for meta-analysis of binary, continuous and diagnostic data
Byron C Wallace, Christopher H Schmid, Joseph Lau and Thomas A Trikalinos
BMC Research Methods
Highly accessed
link
The COPD Genetic Association Compendium: a Comprehensive Online Database of COPD Genetic Associations
PJ Castaldi, MH Cho, M Cohn, F Langerman, S Moran, N Tarragona, H Moukhachen, R Venugopal, D Hasimja, E Kao, BC Wallace, CP Hersh, S Bagade, L Bertram, EK Silverman, TA Trikalinos
Human Molecular Genetics
link