Rijuyuezhu's Blog

Glad to meet you! This is Rijuyuezhu's Blog, where I record awesome things. Enjoy yourself!

This post introduces SGLang, an inference system designed to optimize large language model (LLM) deployment. We focus on:

1. SGLang’s workflow and its distribution setup (e.g., PP/TP/DP constraints);
2. DeepSeek’s inference challenges on SGLang and how DP Attention optimization addresses them.

This article introduces the basic concepts of AI compilation, including its workflow, and its applications such as PyTorch, TVM, and MLIR.

NetEase Mailmaster(网易邮箱大师 in Chinese) is a mail integrated management platform developed by Netease. It provides a .deb package for Ubuntu 22.04. However, for other distributions and versions, installing it with correct dependencies is a bit toublesome. Using containers is a common way to handle this issue. Distrobox provides fantastic device compatibility between the container and the host, and thus is extremely suitable for GUI application containers.

Distrobox is a powerful tool which enables us to run multiple linux distributions and versions simultaneously, and switch among them seemlessly. In addition to the basic features provided by distrobox, I write some more scripts to make it easier to use.

VSCode CLI code <dir/file> is extremely convenient to use. It will open a VSCode session from the terminal. When using sshed terminal at remote, we do want to use such convenience. This tutorial will show how to run code from remote, then VSCode that runs locally will open the remote directory.

Docker containers play an important role in modern software development. Having a CLI access to the container is common, but sometimes we need to expose a GUI from the docker container. Here is a tutorial.

It is tedious to enumerate all of the subgroups of a symmetric group, such as \(S_4\). And I wrote a program to automate it.

In the 3rd Lab of CS:APP: Attack Lab, the distributed binary ctarget is too old and it cannot normally run on today's Ubuntu 22.04. I tried to analyze the problem and raise a resolution for that.

Related stack overflow question.

WeChat is a useful software to communicate with others. Unfortunately, WeChat Official does not provide Linux version. DoChat is a great alternative.