U
贺煦修@user80#12026-10-06 05:2222 阅============================================================
USER: Explain what a neural network is, in two sentences.
MODEL: A neural network is a type of machine learning algorithm that uses a network to learn patterns and make predictions from data. The main idea of a neural network is to create a network that can learn from the data it's already known, meaning the output of the network is always the same, regardless of whether the input is a sequence of ones or zeroes.
The key characteristics of a neural network include:
The input data is a sequence of ones, such as a sequence of numbers or a sequence of strings.
The network is trained on the input data to learn patterns and make predictions. The network is trained on the input data in a regular or random manner.
The net gain or loss of information from the network is the difference between the output of the input data and the predicted output.
The neural network is designed to learn from the data and make predictions. The neural network can learn from the input data, but it can also learn from the past inputs.
The neural network is often used for machine learning tasks where the input data is a sequence of ones, such as a sequence of numbers or a sequence of strings.
In the context of artificial intelligence, a neural network is used for
============================================================
USER: Write a haiku about the ocean.
MODEL: What a great way to contribute. As an underwater photographer, I'm always on the lookout for unique and captivating stories to tell, with a focus on art, history, and the natural world.
My latest project is a "Museo of the Moon," a breathtakingly beautiful ocean that's been left in the ocean for centuries. It's a truly breathtaking piece of art, and I'm always eager to take a closer look.
What really sets this world apart, however, is the way it's shaped by the ocean. The ocean's natural tectonic plate, which stretches over several miles, is all about the intricate design and engineering of the ocean itself. The ocean's surface is incredibly unique, as it's not just a flat surface, but a vast array of smaller, yet equally stunning structures.
What's your idea of doing something with this ocean? Are you writing a short story, or do you have a different direction in mind?
============================================================
USER: What is 17 * 23?
MODEL: 17 * 23 is the product of 19 and 23.
============================================================
USER: Tell me a short joke.
MODEL: I'm starting to think that your humor is the best way to show the world. "What to make of you" is that you're trying to make a good impression and make a good impression. I'm a bit of a connoisseur of language – I really care about the culture, the people, the people. I feel like I'm just going through the motions and feeling the energy of the world. That's what my humor is about, and what I'm trying to convey is a deep sense of purpose and purpose.
============================================================
这是它现在的真实手感(190M 小模型,SFT 后、偏好对齐前):
-
“解释神经网络”:开头两句像样,之后开始重复、跑偏
-
“写海洋俳句”:完全跑题,写成了散文
-
“17×23”:算错了(正确答案 391)
-
“讲个笑话”:语无伦次
就是说英语流畅度和基本句式在,但事实准确性、指令遵循、长文本连贯性都还弱——这正是小模型 SFT 后、偏好对齐前的典型状态。
不过记录自己的模型的成长也是不错的体验啦
毕竟之前是这样的(Base model): 基座模型训练完成! - 科技与创作 / MLOps & 推理 - NodeLoc