Stability AI launches StableCode neural network that can write code

Stability AI has announced a new product called StableCode. It is an LLM-based neural network capable of generating code. This is stated in the company’s message.

This product is designed to help programmers in their daily work and is also a great learning tool for new developers who want to take their skills to the next level.

“StableCode offers a unique way for developers to become more efficient by using three different models to help in their coding. The base model was first trained on a diverse set of programming languages from the stack-dataset (v1.2) from BigCode and then trained further with popular languages like Python, Go, Java, Javascript, C, markdown and C++. In total, we trained our models on 560B tokens of code on our HPC cluster. After the base model had been established, the instruction model was then tuned for specific use cases to help solve complex programming tasks. ~120,000 code instruction/response pairs in Alpaca format were trained on the base model to achieve this result”, said in a Stability AI statement.

After the basic model was created, a special model was adapted to solve complex programming tasks. For this purpose, about 120 thousand pairs were trained in the code/response format.

The company notes that StableCode is an ideal option for those who want to learn more about programming.

“People of every background will soon be able to create code to solve their everyday problems and improve their lives using AI, and we’d like to help make this happen”, added in Stability AI.

Earlier it was reported that Stability AI launches Stable Doodle service that turns sketches into images. The service uses the latest Stable Diffusion model to analyze the contours of a sketch and create a “visually pleasing” artistic image. It is available through the ClipDrop platform.