Yequan's Academic
Yequan's Academic
Home
Projects
Publications
Patents
Talks
Contact
Light
Dark
Automatic
English
English
中文 (简体)
1
Not All Layers of LLMs Are Necessary During Inference
We propose AdaInfer, a lightweight algorithm that adaptively stops LLM inference early based on statistical cues, cutting up to 43% of computation with <1% performance loss and no model modification.
Siqi Fan
,
Xin Jiang
,
Xuying Meng
,
Peng Han
,
Shuo Shang
,
Aixin Sun
,
Yequan Wang
PDF
Cite
Project
Project
Few-Shot Learner Generalizes Across AI-Generated Image Detection
We propose Few-Shot Detector (FSD), a novel AI-generated image detector that learns a metric space to recognize unseen fake images with only a few samples, achieving +11.6% higher accuracy and strong generalization without retraining.
Shiyu Wu
,
Jing Liu
,
Jing Li
,
Yequan Wang
PDF
Cite
Code
Project
Project
Masked Structural Growth for 2x Faster Language Model Pre-training
To lower the computional cost of training large model, we focus on speeding up pre-training by progressively growing from a small Transformer structure to a large one.
Yiqun Yao
,
Zheng Zhang
,
Jing Li
,
Yequan Wang
PDF
Cite
Code
Project
Project
CORT: A New Baseline for Comparative Opinion Classification by Dual Prompts
We approach comparative opinion classification through prompt learning, taking the advantage of embedded knowledge in pre-trained language model. We design a twin framework with dual prompts, named CORT. This extremely simple model delivers state-of-the-art and robust performance on all benchmark datasets for comparative opinion classification. We believe CORT well serves as a new baseline for comparative opinion classification.
Yequan Wang
,
Hengran Zhang
,
Aixin Sun
,
Xuying Meng
PDF
Cite
Code
Dataset
Project
CofeNet: Context and Former-Label Enhanced Net for Complicated Quotation Extraction
We propose the Context and Former-Label Enhanced Net (CofeNet) for quotation extraction. CofeNet is able to extract complicated quotations with components of variable lengths and complicated structures. On two public datasets and one proprietary dataset, we show that our achieves state-of-the-art performance on complicated quotation extraction.
Yequan Wang
,
Xiang Li
,
Aixin Sun
,
Xuying Meng
,
Huaming Liao
,
Jiafeng Guo
PDF
Cite
Code
Dataset
Project
Packet Representation Learning for Traffic Classification
We propose a novel framework to tackle the problem of packet representation learning for various traffic classification tasks. We learn packet representation, preserving both semantic and byte patterns of each packet, and utilize contrastive loss with a sample selector to optimize the learned representations so that similar packets are closer in the latent semantic space.
Xuying Meng
,
Yequan Wang
,
Runxin Ma
,
Haitong Luo
,
Xiang Li
,
Yujun Zhang
PDF
Cite
Code
DOI
Interactive Information Extraction by Semantic Information Graph
We propose an Interactive Information Extraction (InterIE) with a novel Semantic Information Graph (SIG) to guide the IE subtasks jointly.
Siqi Fan
,
Yequan Wang
,
Jing Li
,
Zheng Zhang
,
Shuo Shang
,
Peng Han
PDF
Cite
Code
Dataset
A Dual-Channel Framework for Sarcasm Recognition by Detecting Sentiment Conflict
In this paper, we propose a Dual-Channel Framework by modeling both literal and implied sentiments separately. Based on this dual-channel framework, we design the Dual-Channel Network (DC-Net) to recognize sentiment conflict.
Yiyi Liu
,
Yequan Wang
,
Aixin Sun
,
Xuying Meng
,
Jing Li
,
Jiafeng Guo
PDF
Cite
Code
Dataset
Path Travel Time Estimation using Attribute-related Hybrid Trajectories Network
In this paper, we propose Attribute-related Hybrid Trajectories Network~(AtHy-TNet), a neural model that effectively utilizes the attribute correlations, as well as the spatial and temporal relationships across hybrid trajectory data.
Xi Lin
,
Yequan Wang
,
Xiaokui Xiao
,
Zengxiang Li
,
Sourav S. Bhowmick
PDF
Cite
DOI
Aspect-level Sentiment Analysis using AS-Capsules
In this paper, we propose the aspect-level sentiment capsules model (AS-Capsules), which is capable of performing aspect detection and sentiment classification simultaneously, in a joint manner.
Yequan Wang
,
Aixin Sun
,
Minlie Huang
,
Xiaoyan Zhu
PDF
Cite
Code
Dataset
DOI
»
Cite
×