Jiarun Liu

Jiarun Liu

Chaque personne porte en soi un monde tout entier.

Sitemap

A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.

Pages

Posts

Rebuttal of AllTogether: Investigating the Efficacy of Spliced Prompt for Web Navigation using Large Language Models

less than 1 minute read

Published:

This paper was submitted to COLING 2024 based on the “Class of Talent” Innovation Fund Program. The paper investigates the performance and evaluation of intelligences based on a generalized LLM in accomplishing the Web Navigation task, and designs the AllTogether method to enhance the language grounding capability of the pretrained language model.

CHI alt 2024 Conference Reviewer

less than 1 minute read

Published:

CHI conference is called ACM Conference on Human Factors in Computing Systems, which belongs to CCF-A category. CHI has an open review channel for alt.CHI papers, which allows anyone to review papers under real names.

Financial Data Prediction Based on Wavelet Analysis and Kalman Filter Algorithms

less than 1 minute read

Published:

The experimental part uses real stock market data, denoising and feature extraction of the data by wavelet analysis, and Kalman filtering for state estimation and prediction. The experimental results show that the method of combining wavelet analysis and Kalman filtering can significantly improve the accuracy of prediction compared to using traditional prediction models alone.

The Law Large Language Model Project

less than 1 minute read

Published:

This project mainly relies on the technical route of prompt learning and partial parameter fine-tuning of open-source large language models to realize a large-model intelligent assistant in the legal vertical field for professionals and the public, targeting legal documents, Q&A and legal data. I am responsible for framework design, deployment fine-tuning, evaluation session and interaction design. Check our project’s code, dataset and checkpoints in github.

Meta-DM: Applications of Diffusion Models on Few-Shot Learning

less than 1 minute read

Published:

A paper was produced and submitted to the NIPS 2023 conference and has been rejected. The paper investigates a data augmentation application of the mainstream diffusion model on the small sample task of images. It mainly proposes the Meta-DM framework and verifies that several mainstream algorithms combined with Meta-DM can significantly improve their performance and achieve SOTA.

AllTogether: Investigating the Efficacy of Spliced Prompt for Web Navigation using Large Language Models

less than 1 minute read

Published:

This paper was submitted to COLING 2024 based on the “Class of Talent” Innovation Fund Program. The paper investigates the performance and evaluation of intelligences based on a generalized LLM in accomplishing the Web Navigation task, and designs the AllTogether method to enhance the language grounding capability of the pretrained language model.

Graduation Design

less than 1 minute read

Published:

The title of this graduation design is “Research on Hierarchical Reinforcement Learning Algorithm Based on Option”. After thorough research and thesis study, I implemented an algorithm improvement based on the mainstream IOC algorithm, and tested it in multiple environments for specific evaluation metrics, and verified the improvement of reward scores and interpretability metrics.

Stealth Startup AI Algorithm Engineer Internship Experience

less than 1 minute read

Published:

The company is an overseas startup located in Canada, which wants to build Artificial General Intelligence (AGI) applications in several fields based on the hot technology of large language model. During my internship, I collaborated with several colleagues to develop and deploy web-based AGI intelligences for the Kapwing video editing website and the Instantly email management website based on the techniques of prompt engineering and tool learning.

‘QA-BOT’ Business Q&A Robot

less than 1 minute read

Published:

QA-BOT is an edge AI deployment that detects human gaze, recognizes speech, and implements various business Q&A dialogues based on few-shot learning implemented by open-source large language models. It is low cost, lightweight and easy to fine-tune compared to the market.

A Gesture-Assisted Real-Time Image Description Smart Hardware

less than 1 minute read

Published:

The project deploys deep learning algorithms such as Image Captioning and gesture recognition in AI hardware training. It helps people to get a summary description of the screen or environment and assists visually impaired people to understand their surroundings.

Social APP ‘MINT’

less than 1 minute read

Published:

Based on uniapp and uniCloud, we implemented MINT, a campus social networking application based on “small tasks” and user personality portraits, using recommendation algorithms, front-end and back-end technologies, javascript programming, etc.

Intelligent Car ‘GrandPa’

less than 1 minute read

Published:

The project covers environmental monitoring, intelligent tracking based on AprilTag, four-axis motor drive, and wifi image transmission and remote control. The project is based on python embedded implementation of face recognition, target tracking and other functions.

portfolio

publications

talks

[LM] Out of One, Many

Published:

Mainly prompt experiment, no large deal. Working on bias and skewed margin, now a popular field.

[LM] Mind’s Eye

Published:

The research proposes a new paradigm for large models to implement reasoning about the physical world Mind’s Eye, by getting information from real simulations of physical problems in the Mujoco physics engine, and inputting auxiliary information along with the problems themselves to enable large models, the improvement in UTOPIA baseline is significant and can be done so that small models plus simulations can outperform large models after the effect improvement is significant.

[LM] Chain-of-Thought

Published:

CoT is a form of discrete cue learning. More specifically, contextual learning of language models adds many textual logical representations of thought in between compared to the previous traditional contextual learning (i.e., a series of texts as input for the large model to complete the output).

[RL] Option-Critic

Published:

We have read an important paper on option-based hierarchical reinforcement learning, The Option-Critic Architecture, and have critically reviewed the derivation of the equations to understand the SMDP process in option-state augmented space and the corresponding algorithmic framework.

[LM] Challenging BIG-Bench tasks

Published:

CoT was already available when BIG-Bench first came out, but CoT did not perform well on small scale models (emergent effect could not be achieved), so BIG-Bench did not mention using CoT; but after that, PaLM / Davinci-002 / code-davinvi-002 and other larger scale models appeared. So there was a motivation to verify the effect of CoT on the new baseline of BIG-Bench. Sure enough, CoT is indeed better for many tasks.

[LM] The Debate Over Understanding in AI’s Large Language Models

Published:

The article describes what LLM is, how it is trained and works, and how it works, and then shows that LLM is also brittle and can make mistakes when disturbed. The article points out that there are two opposing voices, one arguing that this is the budding of general intelligence, and the other arguing that LLM only learns the form of language rather than its meaning. The article also shows, with some examples, that shortcut learning, a phenomenon often invoked in machine learning, is also present in LLM, i.e., learning systems that rely on spurious correlations in the data.

[LM][AGI] WebGPT: Browser-assisted question-answering with human feedback

Published:

The study fine-tuned the GPT-3 large model to achieve long-form QA by manipulating browser search, i.e., giving long and meaningful complete answers to open-ended questions. The result is that more than half of the generated results are more satisfying than the answers given by humans, with higher accuracy and information validity.

[ML] A Path Towards Autonomous Machine Intelligence

Published:

Different researchers have different perspectives on the ideas proposed by LeCun, but in general this paper is extremely enlightening and leading. The paper proposes an architecture and training paradigm for building autonomous intelligences, combining concepts such as configurable predictive world models, behavior driven by intrinsic motivation, and hierarchical joint embedding architectures trained by self-supervised learning.

[RL] DAC: The Double Actor-Critic Architecture for Learning Options

Published:

The option framework is reformulated as two parallel augmented MDPs. under this new formulation, all policy optimization algorithms are readily available for learning intra-option policy, termination policy, and master option. we apply AC algorithms on each augmented MDP and The DAC architecture is designed. Combined with the PPO algorithm, an empirical study is conducted on challenging robot simulation tasks.

teaching

The Law Large Language Model Project

Lab, Lab, 2023

This project mainly relies on the technical route of prompt learning and partial parameter fine-tuning of open-source large language models to realize a large-model intelligent assistant in the legal vertical field for professionals and the public, targeting legal documents, Q&A and legal data. I am responsible for framework design, deployment fine-tuning, evaluation session and interaction design. Check our project’s code, dataset and checkpoints in github.

Research and Engineering at Microsoft

Industry Research, Microsoft, Data Knowledge and Intelligence Group, 2024

Our work focused on improving Microsoft products’ accessibility through intelligent algorithms for automated detection and resolution of accessibility issues, along with establishing relevant evaluation frameworks.

Retainer: AI-Powered Game Development Assistant

Research Project, Game Development, 2024

Retainer is an LLM-based agent for game development that enables natural language interaction to assist developers of all skill levels in game development and encapsulation.