Original ChatGPT training requires large-scale parallel connection of high-performance chips, and high-speed interface IP meets the dividend era
In recent years, the boom of ChatGPT has rekindled the boom of AI industry, especially in the field of AIGC (which refers to the use of AI technology to generate content), which has entered into a frenzy. The head technology enterprises are scrambling for the first time to release ChatGPT-like applications.
As we all know, ChatGPT-like applications are a gold gobbler. Microsoft used 10000 high-end GPUs of Yingweida Zhang to train ChatGPT. "From the perspective of training, if GPU chips with better computing performance, such as A100, cannot be clustered together for training, then it may take hundreds of years to train a big model like ChatGPT. Therefore, the training of AI big model is a huge challenge to high-speed interface IP, and also a huge opportunity." Tang Rui, vice president of market and strategy of Kuixin Technology, said in an interview with e-enthusiast.
Kuixin Technology was founded in 2021. The company's slogan is "high-speed interconnection of cores and particles, a source of massive computing power". At present, the high-speed interface IP combination that Quixon has launched includes USB, PCIe, SATA, SerDes, MIPI, DDR, HDMI, DP, HBM and other rich types.
ChatGPT-like driving the development of interface IP
From the perspective of semiconductor industry distribution, IP is the underlying technology, and so is the interface IP. Therefore, the key and importance are self-evident. So what role can interface IP play in AIGC industry? Tang Rui mentioned the following points.
First, the interconnection interface on the chip, that is, the interconnection interface IP of Die to Die type, including UCIE, is used to expand the computing capacity of a single chip; Secondly, the interconnection interface IP of Chip to Chip type, including SerDes/PCIE/CXL, can speed up the interconnection and data exchange between chips to meet the needs of higher bandwidth; In addition, there are memory interface IP, including SATA, DDR, HBM, etc., which can be used to create higher performance storage products and help ChatGPT-like storage and exchange large-scale data; The next layer is the interface IP of the data communication interface. Therefore, from the perspective of training, the explosion of ChatGPT-like applications can bring very large demand for interface IP.
In the previous forecast, data from market research institutions showed that the market size of high-speed Internet IP is expected to grow rapidly at a compound annual growth rate of 75% from 2022 to 2026. "The growth of the interface IP market must follow the general trend of the whole high-performance computing chip, including the improvement of chip computing performance, memory and bandwidth needs the help of interface IP, so the increase of chip usage will certainly lead to greater interface IP usage." Tang Rui believes that, "At the same time, the improvement of the performance of computing chips has been limited by the slowdown of Moore's Law, and the performance of single chips will gradually encounter bottlenecks, so the interconnection of computing power cluster is an effective means, which will also accelerate the development of interface IP."
Although the industry boom is coming, Tang Rui is not worried about the influx of many peers or friends at once, which will cause the domestic interface IP industry to be involved. "The intensity of market competition will increase, but interface IP is a high-threshold field. At present, there are not many domestic talents to do high-speed hybrid circuits, especially those who do high-speed analog circuit design in advanced manufacturing processes. Therefore, it is very difficult to enter this field from scratch." He said.
Layout and catch-up of domestic manufacturers
From the perspective of global industrial structure, in terms of interface IP, at present, EDA manufacturers such as Xinsi Technology and Kaideng Electronics and other international interface IP manufacturers are still in the leading position. Relevant data shows that by 2021, the self-sufficiency rate of domestic interface IP is still less than 10%.
"At present, from the technical point of view, the domestic interface IP manufacturers are still in the catch up position, but the gap has become smaller and smaller." Tang Rui pointed out that "in 2023, Quixon Technology will launch a series of interface IP products with internationally leading performance, including HBM3 and other leading D2D type of interconnection interface IP."
At the same time, he also said that in terms of serving domestic customers, there will actually be a lot of local needs, which need to be combined with the process characteristics of the wafer factory to provide IP solutions. Many IP products of Quixon Technology have received inquiries from customers in the process of research and development or before research and development. They have very clear requirements around the customer's chip architecture. Quixon Technology has established several industrial alliances with its downstream customers. Through these alliances, different types of computing chip companies are united to develop in a coordinated manner, and domestic solutions are built around data center applications to fill the gap in China.
At present, the computing power cluster used in AI large model training is basically built based on Nvidia universal computing power chips. In this regard, there is still a certain performance gap between domestic universal computing power chips. Tang Rui said that there are still opportunities for domestic high-performance computing chips. The AI big model is not a new thing in recent years. In recent years, the domestic AI industry has been following this trend, but the big model parameters behind ChatGPT-like applications are larger. In response to this demand, the domestic chip industry has also started the layout of this aspect for a long time, including the interface IP circuit where Quixon Technology is located, which is working in this direction. However, there will be a time difference between IP R&D, chip design and application landing. In fact, foreign companies are also using the previous chips to provide hardware support in this area through interconnection.
"It also needs to be pointed out that AIGC is a combination of software and hardware. In terms of software, the volume of algorithm model is also a direction worthy of research and breakthrough. At present, the GPT algorithm of Open AI is not the only open source AIGC algorithm in foreign countries. According to the introduction information, there are also some models with smaller parameters that can realize ChatGPT-like applications. We can actually use these models for reference to reduce the demand of software for hardware Pressure. " Tang Rui finally said.
Summary
IP has great leverage on the semiconductor industry. Worldwide, the IP sales of more than US $6 billion drive the global semiconductor market sales of US $500 billion. For domestic chips, it is very difficult to achieve a single chip performance explosion in the short term. However, through high-speed interface IP and computing power cluster, it can also gradually enter the ChatGPT-like dividend market.
ICBROS TECHNOLOGY LIMITED is a worldwide professional electronic components distributor.
【Our hot chip models today:】(In Stock)
Email：service@icbros.com
HK Tel：+852 44058386
Whatsapp：+852 44058386
Skype：jammy@icbros.com
Web：https://www.icbros.com
==============
AD8328ARQZ QSOP20 ADI
ADM8616YCYAKS SC70-4 ADI
ADM8616TCYAKS-RL7 SC70-4 ADI
ADCMP350YKSZ-REEL7 SC70-4 ADI
ADG741BKSZ5-REEL7 SC70-5 ADI
AD8519AKS-REEL7 SC70-5 ADI
ADM823ZYKSZ-R7 SC70-5 ADI
AD5602YKSZ-2500RL7 SC70-6 ADI
HMC560ALM3 SMD ADI
ADUM2402CRWZ-RL SOIC16 ADI
ADP7105ARDZ-3.3-R7 SOIC8 ADI
ADM1032AR-REEL7 SOP ADI
AD8659ARZ SOP ADI
AD7824KRZ SOP ADI
AD8062ARZ SOP ADI
DAC8426FSZ SOP ADI
ADG508FBRW SOP ADI
ADUM4135BRWZ-RL SOP ADI
ADM232AARW-REEL SOP ADI
ADM691AARZ SOP ADI
AD8554ARZ SOP ADI
OP80GS SOP ADI
CMP02CS SOP ADI
ADP3418KRZ-REEL SOP ADI
OP07CR SOP ADI
TMP36FS-REEL SOP ADI
AD9618JR-REEL SOP ADI
ADP3418JR-REEL SOP ADI
ADM1031ARQ-REEL SOP ADI
AD8531AR-REEL SOP ADI
ADT75ARZ-REEL SOP ADI
SSM2143SZ-REEL SOP ADI
SSM2141SZ SOP ADI
AD8032AR SOP ADI
AD8041AR-REEL7 SOP ADI
AD7401YRWZ-REEL7 SOP ADI
OP491GSZ-REEL7 SOP ADI
ADM3419AR SOP ADI
ADUM1281ARZ-RL7 SOP ADI
AD73360ARZ-REEL SOP ADI
AD7476AAKSZ-REEL7 SOP ADI
ADM690AAR SOP ADI
AD8402A10 SOP14 ADI
AD824AR-14 SOP14 ADI
ADA4891-4ARZ-R7 SOP14 ADI
AD8402AR10 SOP14 ADI
AD8184ARZ-REEL7 SOP14 ADI
ADM489ARZ SOP14 ADI
OP484ESZ SOP14 ADI
AD8182ARZ SOP14 ADI
ADUM1234BRWZ SOP14 ADI
AD8402A100 SOP14 ADI
AD824ARZ SOP14 ADI
ADUM4160BRWZ-RL SOP16 ADI
AD7400YRW SOP16 ADI
ADG409BR SOP16 ADI
ADG412BR SOP16 ADI
DG409DY SOP16 ADI
SMP18FS SOP16 ADI
SMP04Es SOP16 ADI
ADE7757ARN SOP16 ADI
AD605AR SOP16 ADI
ADG411BR SOP16 ADI
ADG508FB SOP16 ADI
AD608ARZ SOP16 ADI
ADG512BR SOP16 ADI
ADUM5401ARWZ-RL SOP16 ADI
ADUM3301ARWZ-RL SOP16 ADI
AD7705BRZ SOP16 ADI
ADM202JRNZ SOP16 ADI
AD844JRZ-16-REEL7 SOP16 ADI
AD7524JR-REEL SOP16 ADI
AD8367ARU SOP16 ADI
AD7234XRZ SOP16 ADI
ADUM1400CRWZ. SOP16 ADI
ADUM1300ARWZ-RL SOP-16 ADI
AD7398BRZ SOP-16 ADI
AD811ARz-16 SOP-16 ADI
SW06GS SOP-16 ADI
AD421BRZRL SOP-16 ADI
AD725AR SOP-16 ADI
ADG428BR SOP18 ADI
AD7701AR SOP20 ADI
AD7822BR-REEL SOP20 ADI
==============
Web：https://www.icbros.com
#DAC #pcbuild #icbros #analogelectronics #semimodular #preamplifier #elettronica #supercon #pcbengineer #diyelectronics #eletricistas #emeddedsystems #hobielektronik #electricalprojects #components #makers #engineering #irremote #studentproject #pic24 #eletronica #drscientist #universalrobots #circuitplayground #powersupply #arduinocompatible
More articles:
Banana Pie BPI-P2 Pro single board computer released, equipped with Ruixin Micro-RK3308 processor
https://www.icbros.com/new-92-465-n.html
Original ChatGPT training requires large-scale parallel connection of high-performance chips, and high-speed interface IP meets the dividend era
https://www.icbros.com/new-69-558-n.html
Original products enter the industrial internet, and 5G needs 99.9999% certainty
https://www.icbros.com/new-37-407-n.html
Banana Pie BPI-P2 Pro single board computer released, equipped with Ruixin Micro-RK3308 processor
https://www.icbros.com/new-60-664-n.html
What is gallium nitride semiconductor? How does GaN transform the 5G network?
https://www.icbros.com/new-3-138-n.html
The progress made in grid driver IC enables switching power supply to achieve a new power density level
https://www.icbros.com/density2-n.html
Discussion on the integrated solution of "semiconductor" photonics
https://www.icbros.com/integrated2-n.html
Semiconductor eMarker HUSB332D opens the 4-pin emarker era for USB Type-C cable
https://www.icbros.com/eMarker-n.html
What are the advantages of AMD Radeon PRO workstation graphics card?
https://www.icbros.com/advantages2-n.html
Qualcomm CEO: Apple is expected to launch its own 5G baseband next year
https://www.icbros.com/Qualcomm-n.html
Semiconductor channel providers: inventory reduction is slower than expected
https://www.icbros.com/Semiconductor-n.html
