I built a budget server to run yalm 100b at home.

Программирование

After experimenting with yalm 100b , an obsession appeared that I should assemble a budget server for this business. I don’t know why, just to finish what I started. As previous experience has shown, you need a server motherboard with 256gb + RAM. I started to study the market, and as they suggested on Habré, prices for DDR4 bite, but for server DDR3 heaps in any volume. But I needed a very budget. Out of all of this, this package seemed to me the most profitable.I built a budget server to run yalm 100b at home.When ordered it cost about 40k. As it turned out later, it was quite expensive. But when I saw 256gb of RAM in the kit, I didn’t really think much. After local RAM prices. But while waiting for delivery, I realized that it was too expensive and not expandable. Therefore, while I was waiting, I also ordered a server motherboard with nine PCIe slots, which is Asus Z9PG-D16 / FDR, which was installed in ASUS ESC4000 G2 graphics stations. I built a budget server to run yalm 100b at home.  Well, RTX 3090 24gb to the heap, so that 3070ti 8gb does not torment. I built a budget server to run yalm 100b at home.The first to come was the Chinese miracle jingsha. Full set, suddenly without RAM. What I ordered for. I wrote to the intermediary to leave a negative review for the seller. But it turned out that he sent the RAM in another package. And in just a couple of weeksmemory also came. I started collecting everything. And what was my surprise that it did not work … everything turns on, but there is no picture on the monitor. I have tried every available PSU and video card. Didn’t work. No sounds, no errors, nothing. All signs of work, the cooler is spinning, everything is heating up, the diodes are on. But there is no picture. After studying the Internet, I found out that contacts are oxidized and exactly the same signs of problems as mine. I bought several types of erasers, stocked up on alcohol. I wiped all contacts both in memory and on processors. Nothing. I even bought an additional memory bar new and two spare E5 2070-v2. Did not help. Next came the very long-awaited server board. The real one, not this jingsha. But with her, too, there was a nuance. She had a proprietary connector. Fortunately, the seller warned about it in advance. Otherwise, this motherboard would have been a Kapeets. Asus food. Ground above, four 12v lines below. Well, control signals.I built a budget server to run yalm 100b at home.I built a budget server to run yalm 100b at home.He stood it on the shelf, danced around the dead jingsha again, walked around the asus one more time … decided to act. I studied about 12v lines, I wanted to buy an expensive PSU just for these purposes. But I decided to risk my PSU, just in case. Because a lot said that all available civilian versions do not have different 12v lines and in general everything comes from one. So … you need to try to repin what is. In order not to spoil my block, I began to look for an adapter. And thank bitcoin and miners, now there is a lot of stuff like that. Found something like this

I built a budget server to run yalm 100b at home.

It is very inconvenient to repin the black wires. But after years of trapping
fleasbugs eyes are trained on attentiveness. In the box with the motherboard you can see the power connector. Took him. As a result, the re-pinned power supply from a home PSU looks something like this. I took the missing fake “lines” 12v or ground from the PCI / CPU connectors, throwing them through the video card adapter. As a result, not a single pin of the 850W PSU was damaged. It looked like this. I built a budget server to run yalm 100b at home.It was very dumb to start. But surprisingly… it worked! Then there was the matter of technology. I fiddled with the monitor first. More precisely, a vga-hdmi adapter, since the image did not start from the video card without drivers. Further, with the fact that the OS did not start with ssd m2. Used usb ssd for os. Then m2 pulled itself up and everything worked right away, since everything was already preinstalled and configured there.I built a budget server to run yalm 100b at home.I built a budget server to run yalm 100b at home.In this config, a small fragment is generated in the region of two hours. Accordingly, the article will take about a day. You can optimize by switching to PCIe 4.0 and DDR4. The generation time will be reduced by about half. Well, or expand the motherboard to 9 rtx 3090. I just had such an expansion plan. But only after I spend all my experiments with different settings. And … the experiments were disappointing. About borscht and simple topics generates texts with a bang. But about investments, the stock market, trading, etc., it turns out to be a complete mess. Or nothing happens at all and just a phrase with context in a row. Which I generated for about a day :)) Here are some more examples:  

{“prefix”: ” How to cook borscht. “, “suffix”: “\nReal Ukrainian borscht.\nEveryone in our family loves borscht.\nI have tried many different ways to make borscht, but this borscht recipe is the bomb!\ nI recommend everyone to cook borscht according to my recipe.\nIf it is not clear to someone, write comments, I will answer you.\nTo prepare borscht you will need: 1 kg of pork, 4 potatoes, 3 onions, 3 carrots, 4 sweet peppers, 3 tomatoes, 5 -6 small cabbage heads, 400 g cabbage (or so), 700-800 g beets, 1 head of garlic, 2-3 bay leaves, ground red pepper, ground black pepper, salt, “}
{“prefix”: ” How to trade by DOM“, “suffix”: ” Forex quotes\n20 May 2016 Aleksey Sedykh Leave a comment\nForex trading strategies by the DOM are gaining more and more popularity.\nNevertheless, Forex beginners may have a question – how to trade DOM correctly?\ nHow to understand at what moment to open a trade, how much to invest in a position, what stop losses to set?\nIn fact, everything is not as difficult as it seems.\nTraders learn this in practice, and, most importantly, studying one situation will allow you to draw up a general understanding of the principles of operation.\nLet’s consider the principle of the Forex DOM trading strategy using an example.\nThere is a large player who wants to capture the market.\nHe buys a large amount of currency at a low price and sells it at a high one.\nLet’s say this makes a hedge- fund or market maker.\nIf a trader just sits and looks at the quote columns, he is unlikely to guess what is happening in the market.\nYou need to remember only two things:\nWhen a big player captures the market, buys a large amount of currency, he sells it with the help of a market maker. \nNaturally, a trader who is “in the know” expects the seller to start buying at the moment of closing the gap resulting from the previous transaction.\nIf a trader finds large buy / sell orders in the order book, he will be able to understand when a large player will come and start selling/buying currency.\nTo do this, you will have to study time indicators, because not only quotes are important, but also time.\nThe classic version of making deals when trading on the Forex DOM\nThere is a classic version of work,when a trader waits in the trading platform for the arrival of a major player and opening a sell/buy position at market prices.\nPurchase or sale of a currency occurs at the Ask or Bid price (for sale or purchase, respectively).\nLet’s consider the classic version of the work.\nYou need to open an account with any online brokerage company or Forex dealer for trading.\nPlace such a glass of quotes in the MT4 trading terminal.\nNext, we are waiting for the arrival of a major player and his entry into the market.\nWe have set a glass of quotes\nWhen we receive a glass of quotes, we open a deal with the broker at the same time as the specified player, but set Take Profit a few points more so that we can close the position earlier when profit is reached.\nWhen a large player enters the market, we get profit. \nThen we close the position some time after the big player finishes entering the market.\nHow long to wait until the big player finishes entering the market?\nIt’s hard to say in advance.\nEach player comes with his own individual mood, so it’s hard to say for sure.\ nYou can judge by the order book.\nIf there is a large offer to sell, but there is no offer to buy, this is the first sign that a major player has left the market.\nIf there is a large offer to buy, but there is no sale, this is the first sign that a major player has left market.\nIn simple words, in the order book of a major player, you need to look for such an offer that covers his position with the aim of buying or selling.\nThere will be several periods when the player closes his position, but the Forex price goes up or down, or large players hold back the rate with their purchases.\nThis is an important point, since a trader must remember that there can be an unlimited number of offers in the glass of quotes of a large player.\nTherefore, you need to carefully monitor his offer and how the price moves in the market.\nAs large players close players will change both the volume and the number of offers.\nNow all that remains is to make sure that a large offer is highlighted.\nIf a trader sees it, he will be able to enter the market.\nWhen he finds an offer,will show Heiken Ashi candles or other similar technical indicators, it will enter the market.\nThen it remains to wait for profit taking and closing the position.\nAs you can see, in order to trade on the Forex DOM, you only need an MT4 terminal.\nThis is a very convenient tool , which allows you to receive information about the state of the market in real time\n”}
{“prefix”: ” How to trade by the glass “, “suffix”: “?\nHow to trade by the glass?\nTrade by the glass is one of the easiest ways to trade on the exchange.\nHowever, despite its simplicity, trading by the glass has its features and nuances that must be taken into account when trading.\nIn this article, we will look at the main points of trading with a glass, and also talk about how to trade glasses on the exchange.\nTrading with a glass on the exchange\nTrading with a glass is one of the simplest ways to trade on the stock exchange.\nHowever, despite its simplicity, trading by the glass has its own characteristics and nuances that must be taken into account when trading.\nIn this article, we will consider the main points of trading”}

On this I consider the gestalt closed. It was very interesting and the joy from the completed task was received.

The purchased equipment will be used as a slave server for databases and dumps. And most importantly, 3090 will serve in the research and processing of exchange data. Perhaps we will meet with yalm 100b again, but only when there are successes with AI and the fleet of video cards expands. ps A budget replacement for 3090 from memory can be tesla m40 24gb. But it is three times weaker, while with the same memory bus size and power consumption. And then it’s harder to sell. So this option is also not. Thank you for your attention!

Pavel
Rate author
Add a comment

  1. Данила

    Отличная статья, не у всех вообще такая возможность сейчас найдется затестить. Спасибо за труды!
    На хабре в комментах к оф статье от яндекса, разбирали ребята всякие особенности работы, запуска.

    На самом деле возможность держать такого зверя в оффлайне и быть не зависимым от предоставления подобных услуг генерации ИИ, это настоящая свобода от цензуры и корпоративных ограничений накладываемых на системы подобные, которые могут не пропускать самые интересные и ценные результаты гипотетически.
    Конечно для тестирования полноценного и отладки работы нужна скорость для мгновенной генерации..

    В любом случае впечатляющая статья!

    Reply
  2. Данила

    Отличная статья, не у всех вообще такая возможность сейчас найдется затестить. Спасибо за труды!
    На хабре в комментах к оф статье от яндекса, разбирали ребята всякие особенности работы, запуска.

    На самом деле возможность держать такого зверя в оффлайне и быть не зависимым от предоставления подобных услуг генерации ИИ, это настоящая свобода от цензуры и корпоративных ограничений накладываемых на системы подобные, которые могут не пропускать самые интересные и ценные результаты гипотетически.
    Конечно для тестирования полноценного и отладки работы нужна скорость для мгновенной генерации..

    В любом случае впечатляющая работа!

    Reply