Publications

SeaBird: Segmentation in Bird’s View with Dice Loss Improves Monocular 3D Detection of Large Objects
Abhinav Kumar, Yuliang Guo, Xinyu Huang, Liu Ren, Xiaoming Liu. Conference on Computer Vision and Pattern Recognition (CVPR), 2024
Tags: Monocular 3D object detection
Code Article

DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training
A. Chen*, Y. Zhang*, J. Jia, J. Diffenderfer, J. Liu, K. Parasyris, Y. Zhang, Z. Zhang, B. Kailkhura, S. Liu. International Conference on Learning Representations (ICLR), 2024
Tags: Scalable Machine Learning
Code

SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation
C. Fan*, J. Liu*, Y. Zhang, D. Wei, E. Wong, S. Liu. International Conference on Learning Representations (ICLR), 2024 (Spotlight).
Tags: Trustworthy Machine Learning
Code

FarSight: A Physics-Driven Whole-Body Biometric System at Large Distance and Altitude
F. Liu, R. Ashbaugh, N. Chimitt, N. Hassan, A. Hassani, A. Jaiswal, M. Kim, Z. Mao, C. Perry, Z. Ren, Y. Su, P. Varghaei, K. Wang, X. Zhang, S. Chan, A. Ross, H. Shi, Z. Wang, A. Jain, X. Liu. IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2024
Tags: Biometric Recognition

ChatGPT-Powered Hierarchical Comparisons for Image Classification
Zhiyuan Ren, Yiyang Su, Xiaoming Liu. Conference on Neural Information Processing Systems (NeurIPS), 2023
Tags: Computer Vision
Code

Model Sparsity Can Simplify Machine Unlearning
J. Jia*, J. Liu*, P. Ram, Y. Yao, G. Liu, Y. Liu, P. Sharma, S. Liu (*represents equal contribution). Conference on Neural Information Processing Systems (NeurIPS), 2023 (Spotlight).
Tags: Privacy and Security, Trustworthy Machine Learning
Code

To Impute or Not: Recommendations for Multibiometric Fusion
M. R. Dale, E. Singer, B. J. Borgström, A. Ross. IEEE International Workshop on Information Forensics and Security (WIFS), 2023
Tags: Multibiometric Fusion

Fully Homomorphic Encryption Operators for Score and Decision Fusion in Biometric Identification
T. Sharma, M. Wason, V. Boddeti, A. Ross, N. Ratha. IEEE International Workshop on Information Forensics and Security (WIFS), 2023
Tags: Biometrics, Identification
Article

Distance-Based Propagation for Efficient Knowledge Graph Reasoning
Harry Shomer, Yao Ma, Juanhui Li, Bo Wu, Charu C. Aggarwal, Jiliang Tang. Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Tags: Knowledge Graphs

Evaluating Graph Neural Networks for Link Prediction: Current Pitfalls and New Benchmarking
Juanhui Li*, Harry Shomer*, Haitao Mao, Shenglai Zeng, Yao Ma, Neil Shah, Jiliang Tang, Dawei Yin (*represents equal contribution). Conference on Neural Information Processing Systems (NeurIPS), 2023
Tags: Graph Neural Networks

Towards Label Position Bias in Graph Neural Networks
Haoyu Han, Xiaorui Liu, Feng Shi, MohamadAli Torkamani, Charu C. Aggarwal, Jiliang Tang. Conference on Neural Information Processing Systems (NeurIPS), 2023
Tags: Graph Neural Networks

Demystifying Structural Disparity in Graph Neural Networks: Can One Size Fit All?
Haitao Mao, Zhikai Chen, Wei Jin, Haoyu Han, Yao Ma, Tong Zhao, Neil Shah, Jiliang Tang. Conference on Neural Information Processing Systems (NeurIPS), 2023
Tags: Graph Neural Networks

Into the LAION’s Den: Investigating Hate in Multimodal Datasets
Adeba Birhane, Vinay Uday Prabhu, Vishnu Boddeti, Sanghyun Han, Sasha Luccioni. Conference on Neural Information Processing Systems (NeurIPS), 2023

Tame a Wild Camera: In-the-Wild Monocular Camera Calibration
Shengjie Zhu, Abhinav Kumar, Masa Hu, Xiaoming Liu. Conference on Neural Information Processing Systems (NeurIPS), 2023
Tags: Computer Vision
Code

PrObeD: Proactive Object Detection Wrapper
Vishal Asnani, Abhinav Kumar, Suya You, Xiaoming Liu. Conference on Neural Information Processing Systems (NeurIPS), 2023
Tags: Computer Vision
Code

Understanding Deep Gradient Leakage via Inversion Influence Functions
Haobo Zhang, Junyuan Hong, Yuyang Deng, Mehrdad Mahdavi, and Jiayu Zhou. Conference on Neural Information Processing Systems (NeurIPS), 2023
Tags: Robustness

Selectivity Drives Productivity: Efficient Dataset Pruning for Enhanced Transfer Learning
Y. Zhang*, Y. Zhang* , A. Chen*, J. Jia, J. Liu, G. Liu, M. Hong, S. Chang, S. Liu (*represents equal contribution). Conference on Neural Information Processing Systems (NeurIPS), 2023
Tags: Dataset Pruning, Efficient Artificial Intelligence
Code

Syntax-Guided Transformers: Elevating Compositional Generalization and Grounding in Multimodal Environments
Danial Kamali, Parisa Kordjamshidi. Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Tags: Compositional Generalization, Multi-modal Grounding, Syntactic Parsing, Vision and Language Tasks

Action Temporality Modeling for Video Question Answering
J. Chen, J. Zhu, Y. Kong. ACM International Conference on Multimedia (MM), 2023

Code

A Mix-up Strategy to Enhance Adversarial Training with Imbalanced Data
Wentao Wang, Harry Shomer, Yuxuan Wan, Yaxin Li, Jiangtao Huang and Hui Liu. ACM International Conference on Information and Knowledge Management (CIKM), 2023
Tags: Adversarial Machine Learning

Single-Cell Multimodal Prediction via Transformers
Wenzhuo Tang, Hongzhi Wen, Renming Liu, Jiayuan Ding, Wei Jin, Yuying Xie, Hui Liu, Jiliang Tang. Proceedings of 32nd ACM International Conference on Information and Knowledge Management (CIKM) 2023
Tags: Graph Neural Networks, Single-Cell Analysis

AutoFHE: Automated Adaption of CNNs for Efficient Evaluation over FHE
Wei Ao, Vishnu Naresh Boddeti. USENIX Security Symposium, 2023
Tags: Automated Machine Learning, Secure Machine Learning
Code Article

Uncertainty-aware State Space Transformer for Egocentric 3D Hand Trajectory Forecasting
Wentao Bao, Lele Chen, Libing Zeng, Zhong Li, Yi Xu, Junsong Yuan, Yu Kong. International Conference on Computer Vision (ICCV), 2023
Tags: Computer Vision, Video Understanding
Demo Code Article

Reinforcement learning approach to sedation and delirium management in the intensive care unit
Eghbali, N., Alhanai, T., & Ghassemi, M. M.. IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), 2023

GIPCOL: Graph-Injected Soft Prompting for Compositional Zero-Shot Learning
Guangyue Xu, Joyce Chai, Parisa Kordjamshidi. IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2023

Discovering Adaptable Symbolic Algorithms from Scratch
Stephen Kelly, Daniel S. Park, Xingyou Song, Mitchell McIntire, Pranav Nashikkar, Ritam Guha, Wolfgang Banzhaf, Kalyanmoy Deb, Vishnu Naresh Boddeti, Jie Tan, Esteban Real. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023

Robust Mixture-of-Expert Training for Convolutional Neural Networks
Y. Zhang, R. Cai, T. Chen, G. Zhang, H. Zhang, P.-Y. Chen, S. Chang, Z. Wang, S. Liu. International Conference on Computer Vision (ICCV), 2023
Tags: Adversarial Machine Learning, Efficient Artificial Intelligence, Trustworthy Artificial Intelligence
Code

MetaReVision: Meta-Learning with Retrieval for Visually Grounded Compositional Concept Acquisition
Guangyue Xu, Parisa Kordjamshidi, Joyce Chai. Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023

Disentangling Extraction and Reasoning in Multi-hop Spatial Reasoning
Roshanak Mirzaee, Parisa Kordjmashidi. Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Tags: Disentangling Extraction and Reasoning, Large Language Models, Spatial Reasoning

On the Biometric Capacity of Generative Face Models
Vishnu Naresh Boddeti, Gautam Sreekumar, Arun Ross. IEEE International Joint Conference on Biometrics (IJCB), 2023

Code

Dual-Phase Models for Extracting Information and Symbolic Reasoning: A Case-Study in Spatial Reasoning
Roshanak Mirzaee, Parisa Kordjmashidi. International Joint Conference on Artificial Intelligence (IJCAI) Workshop on Spatio-Temporal Reasoning and Learning, 2023
Tags: Disentangling Extraction and Reasoning, Pretrained Language Models, Spatial Reasoning, Spatial Role Labeling
Article

AG-ReID 2023: Aerial-Ground Person Re-identification Challenge Results
K. Nguyen, C. Fookes, S. Sridharan, F. Liu, X. Liu, A. Ross, D. Michalski, H. Nguyen, D. Deb, M. Kothari, M. Saini, D. Du, S. McCloskey, G. Bertocco, F. Andal, T. E. Boult, A. Rocha, H. Zhu, Z. Zheng, R. Nevatia, Z. Randhawa, S. Sabri, G. Doretto. IEEE International Joint Conference on Biometrics (IJCB), 2023
Tags: Biometrics
Code

Vocal Style Factorization for Effective Speaker Recognition in Affective Scenarios
M. Sandler and A. Ross. IEEE International Joint Conference on Biometrics (IJCB), 2023
Tags: Speaker Recognition
Code

iWarpGAN: Disentangling Identity and Style to Generate Synthetic Iris Images
S. Yadav and A. Ross. IEEE International Joint Conference on Biometrics (IJCB), 2023
Tags: Biometrics, Synethetic Iris

Voice Morphing: Two Identities in One Voice
S. K. Pani, A. Chowdhury, M. Sandler, A. Ross. International Conference of the Biometrics Special Interest Group (BIOSIG), 2023
Tags: Voice Morphing
Code

Physics informed neural network for dynamic stress prediction
Hamed Bolandi, Gautam Sreekumar, Xuyang Li, Nizar Lajnef, Vishnu Naresh Boddeti. Applied Intelligence, 2023

Generative Diffusion Models on Graphs: Methods and Applications
Wenqi Fan, Chengyi Liu, Yunqing Liu, Jiatong Li, Hang Li, Hui Liu, Jiliang Tang, Qing Li. International Joint Conference on Artificial Intelligence (IJCAI), 2023
Tags: Graph Diffusion Models, Graph Neural Networks

Self-Recover: Forecasting Block Maxima in Time Series from Predictors with Disparate Temporal Coverage using Self-Supervised Learning
Asadullah Hill Galib, Andrew McDonald, Tyler Wilson, Lifeng Luo, and Pang-Ning Tan. International Joint Conference on Artificial Intelligence (IJCAI), 2023
Tags: Data Fusion, Time Series Forecasting
Code

Enhancing Graph Representations Learning with Decorrelated Propagation
Hua Liu, Haoyu Han, Wei Jin, Xiaorui Liu, Hui Liu. ACM Conference on Knowledge Discovery and Data Mining (SIGKDD), 2023
Tags: Graph Neural Networks

How does the Memorization of Neural Networks Impact Adversarial Robust Models?
Han Xu, Xiaorui Liu, Wentao Wang, Zitao Liu, Anil K. Jain, Jiliang Tang. ACM Conference on Knowledge Discovery and Data Mining (SIGKDD), 2023
Tags: Adversarial Machine Learning

Distributed Adversarial Training to Robustify Deep Neural Networks at Scale
G. Zhang*, S. Lu*, Y. Zhang, X. Chen, P.-Y. Chen, Q. Fan, L. Martie, L. Horesh, M. Hong, S. Liu (*represents equal contribution). Conference on Uncertainty in Artificial Intelligence (UAI), 2023 Best Paper Runner-Up Award.
Tags: Adversarial Machine Learning
Code

Reverse engineering of generative models: Inferring model hyperparameters from generated images
Vishal Asnani, Xi Yin, Tal Hassner, Xiaoming Liu. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
Tags: Deepfake Detection, Fingerprint Estimation, Generative Models, Image Attribution, Reverse Engineering

Heat-Assisted Detection and Ranging
Fanglin Bao, Xueji Wang, Shree Hari Sureshbabu, Gautam Sreekumar, Liping Yang, Vaneet Aggarwal, Vishnu Naresh Boddeti, Zubin Jacob. Nature, 2023

Code Article

Revisiting Data-Free Knowledge Distillation with Poisoned Teachers
Junyuan Hong, Yi Zeng, Shuyang Yu, Lingjuan Lyu, Ruoxi Jia, and Jiayu Zhou. International Conference on Machine Learning (ICML), 2023
Tags: Robustness, Trustworthy Artificial Intelligence

Alternately Optimized Graph Neural Networks
Haoyu Han, Xiaorui Liu, Haitao Mao, MohamadAli Torkamani, Feng Shi, Victor Lee, Jiliang Tang. International Conference on Machine Learning (ICML), 2023
Tags: Graph Neural Networks

Probabilistic Categorical Adversarial Attack and Adversarial Training
Han Xu, Penghei He, Jie Ren, Yuxuan Wan, Zitao Liu, Jiliang Tang. International Conference on Machine Learning (ICML), 2023
Tags: Adversarial Machine Learning

Linearly Constrained Bilevel Optimization: A Smoothed Implicit Gradient Approach
P. Khanduri, I. Tsaknakis, Y. Zhang, J. Liu, S. Liu, J. Zhang, M. Hong. International Conference on Machine Learning (ICML), 2023
Tags: Optimization

Graph Enhanced BERT for Query Understanding
Juanhui Li, Yao Ma, Wei Zeng, Suqi Cheng, Jiliang Tang, Shuaiqiang Wang, Dawei Yin. ACM International Conference on Research and Development in Information Retrieval (SIGIR), 2023
Tags: Graph Neural Networks

MOAZ: A Multi-Objective AutoML-Zero Framework
Ritam Guha, Wei Ao, Stephen Kelly, Vishnu Boddeti, Erik Goodman, Wolfgang Banzhaf, Kalyanmoy Deb. Genetic and Evolutionary Computation Conference (GECCO), 2023
Tags: AutoML-Zero, Multi-Objective Optimization
Code

Learning Clothing and Pose Invariant 3D Shape Representation for Long-Term Person Re-Identification
Feng Liu, Minchul Kim, ZiAng Gu, Anil Jain, Xiaoming Liu. International Conference on Computer Vision (ICCV), 2023
Tags: Computer Vision
Code

Are Graph Neural Networks Really Helpful for Knowledge Graph Completion?
Juanhui Li, Harry Shomer, Jiayuan Ding, Yiqi Wang, Yao Ma, Neil Shah, Jiliang Tang, Dawei Yin. Findings of the Association for Computational Linguistics (ACL), 2023
Tags: Knowledge Graphs

Race, Gender, and Age Biases in Biomedical Masked Language Models
Michelle YoungJin Kim, Junghwan Kim, Kristen Marie Johnson. Findings of the Association for Computational Linguistics (ACL), 2023
Tags: Artificial Intelligence Fairness, Biomedical Natural Language Processing, Natural Language Processing
Article

Transfer Learning in Deep Reinforcement Learning: A Survey
Zhuangdi Zhu, Kaixiang Lin, Anil K. Jain, and Jiayu Zhou. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
Tags: Transfer Learning

Seed Feature Maps-based CNN Models for LEO Satellite Remote Sensing Services
Zhichao Lu, Chuntao Ding, Shangguang Wang, Ran Cheng, Felix Juefei-Xu, Vishnu Naresh Boddeti. International Conference on Web Services (ICWS), 2023

GLUECons: A Generic Benchmark for Learning under Constraints
Hossein Rajaby Faghihi, Aliakbar Nafar, Chen Zheng, Roshanak Mirzaee, Yue Zhang, Andrzej Uszok, Alexander Wan, Tanawan Premsri, Dan Roth, Parisa Kordjamshidi. Conference on Artificial Intelligence (AAAI), 2023
Tags: Benchmark, Computer Vision, DomArtificial Intelligencen Knowledge Integration, Natural Language Processing, Neuro-Symbolic Artificial Intelligence, Reasoning
Code Article

PMatch: Paired Masked Image Modeling for Dense Geometric Matching
Shengjie Zhu, Xiaoming Liu. Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Tags: Computer Vision
Code

Hierarchical fine-grained image forgery detection and localization
Xiao Guo, Xiaohong Liu, Zhiyuan Ren, Steven Grosz, Iacopo Masi, Xiaoming Liu. Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Tags: Computer Vision
Code

Malp: Manipulation localization using a proactive scheme
Vishal Asnani, Xi Yin, Tal Hassner, Xiaoming Liu. Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Tags: Computer Vision
Code

LightedDepth: Video Depth Estimation in light of Limited Inference View Angles
Shengjie Zhu, Xiaoming Liu. Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Tags: Computer Vision
Code Article

Rethinking Domain Generalization for Face Anti-spoofing: Separability and Alignment
Yiyou Sun, Yaojie Liu, Xiaoming Liu, Yixuan Li, Wen-Sheng Chu. Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Tags: Computer Vision
Code

DCFace: Synthetic Face Generation with Dual Condition Diffusion Model
Minchul Kim, Feng Liu, Anil Jain, Xiaoming Liu. Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Tags: Computer Vision
Code

Revisiting Residual Networks for Adversarial Robustness
Shihua Huang, Zhichao Lu, Kalyanmoy Deb, Vishnu Naresh Boddeti. Conference on Computer Vision and Pattern Recognition (CVPR), 2023

Code

Mitigating Task Interference in Multi-Task Learning via Explicit Task Routing with Non-Learnable Primitives
Chuntao Ding, Zhichao Lu, Shangguang Wang, Ran Cheng, Vishnu Naresh Boddeti. Conference on Computer Vision and Pattern Recognition (CVPR), 2023

Code

ProTéGé: Untrimmed Pretraining for Video Temporal Grounding by Video Temporal Grounding
Lan Wang, Gaurav Mittal, Sandra Sajeev, Ye Yu, Matthew Hal, Vishnu Naresh Boddeti, Mei Chen. Conference on Computer Vision and Pattern Recognition (CVPR), 2023

Understanding and Improving Visual Prompting: A Label-Mapping Perspective
A. Chen, Y. Yao, P.-Y. Chen, Y. Zhang, S. Liu. Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Tags: Efficient Artificial Intelligence, ExplArtificial Intelligencenability
Code Article

Text-Visual Prompting for Efficient 2D Temporal Video Grounding
Y. Zhang , X. Chen, J. Jia, S. Liu, K. Ding. Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Tags: Computer Vision, Efficient Artificial Intelligence
Code Article

Automation of protocoling advanced MSK examinations using natural language processing techniques
Eghbali, N., Clochko, C., Siegal, D., & Ghassemi, M. M.. Proceedings of the American Medical Informatics Association 2023

The Role of Semantic Parsing in Understanding Procedural Text
Hossein Rajaby Faghihi, Parisa Kordjamshidi, Choh Man Teng, James Allen. Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
Tags: Explainability, Graph, Natural Language Processing, Neuro-Symbolic Artificial Intelligence

How Robust is Your Fairness? Evaluating and Sustaining Fairness under Unseen Distribution Shifts
Haotao Wang, Junyuan Hong, Jiayu Zhou, and Zhangyang Wang. Transactions on Machine Learning Research (TMLR), 2023
Tags: Robustness

VLN-Trans, Translator for the Vision and Language Navigation Agent
Yue Zhang, Parisa Kordjamshidi. Findings of the Association for Computational Linguistics (ACL), 2023

MECTA: Memory-Economic Con- tinual Test-Time Model Adaptation
Junyuan Hong, Lingjuan Lyu, Jiayu Zhou, and Michael Spranger. International Conference on Learning Representations (ICLR), 2023
Tags: Efficient Artificial Intelligence

Turning the Curse of Heterogeneity in Federated Learning into a Blessing for Out-of-Distribution Detection
Shuyang Yu, Junyuan Hong, Haotao Wang, Zhangyang Wang, and Jiayu Zhou. International Conference on Learning Representations (ICLR), 2023
Tags: Robustness, Trustworthy Artificial Intelligence

Transferable Unlearnable Examples
Jie Ren, Han Xu, Yuxuan Wan, Xingjun Ma, Lichao Sun, Jiliang Tang. International Conference on Learning Representations (ICLR), 2023
Tags: Trustworthy Artificial Intelligence, Unlearning

Empowering Graph Representation Learning with Test-Time Graph Transformation
Wei Jin, Tong Zhao, Jiayuan Ding, Yozen Liu, Jiliang Tang, Neil Shah. International Conference on Learning Representations (ICLR), 2023
Tags: Graph Neural Networks, Robustness

TextGrad: Advancing Robustness Evaluation in NLP by Gradient-Driven Optimization
B. Hou, J. Jia, Y. Zhang, G. Zhang, Y. Zhang, S. Liu, S. Chang. International Conference on Learning Representations (ICLR), 2023
Tags: Adversarial Machine Learning
Code

What Is Missing in IRM Training and Evaluation? Challenges and Solutions
Y. Zhang, P. Sharma, P. Ram, M. Hong, K. Varshney, S. Liu. International Conference on Learning Representations (ICLR), 2023
Tags: Automated Artificial Intelligence
Code

Toward Degree Bias in Embedding-Based Knowledge Graph Completion
Harry Shomer, Wei Jin, Wentao Wang, Jiliang Tang. ACM Web Conference (WWW), 2023
Tags: Graph Neural Networks, Knowledge Graphs

Analyzing the Impact of Vaccinations and Weather Factors on the COVID-19 Pandemic
O. Iloanusi, N. Iloanusi, A. Ross. Current Medical Research and Opinion, 2023

Article

On the Design of the MIT LL Trimodal Dataset for Identity Verification
E. Singer, B. J. Borgström, K. Alperin, T. Nguyen, C. Dagli, M. R. Dale, and A. Ross. International Workshop on Biometrics and Forensics (IWBF), 2023
Tags: Biometrics, Identity Verification
Article

ClawSAT: Towards Both Robust and Accurate Code Models
J. Jia*, S. Srikant*, T. Mitrovska, C. Gan, S. Chang, S. Liu, U. O’Reilly (*represents equal contribution). International Conference on Software Analysis Evolution and Reengineering (SANER), 2023
Tags: Adversarial Machine Learning, Natural Language Processing, Trustworthy Artificial Intelligence
Code

Publications

Contact