Issue link: https://digital.copcomm.com/i/1513434
10 cgw o c t o b e r • n o v e m b e r • d e c e m b e r 2 0 2 3 Puget Systems: Custom Generative AI & ML Server RECON Labs: 3Dpresso AI 3D Model Creation Tool RECON Labs: 3Dpresso AI 3D Model Creation Tool P U G E T S Y S T E M S : C U S T O M G E N E R A T I V E A I A N D M A C H I N E L E A R N I N G S E R V E R Puget Systems debuted a custom Generative AI and Machine Learn- ing server at SIGGRAPH 2023. Congured with four Nvidia RTX 6000 Ada graphics cards, the specialized new server is designed to handle intensive generative AI and machine learning and to eectively man- age real-time rendering, graphics, AR/MR/VR/XR, compute, and deep learning processing. The AI Training and Inference server is a rackmount workstation capable of hosting a web-based chat server using STOA (spa- tial-temporal modeling of object and action) models such as the Meta-Llama-2-70b large language models (LLMs) supporting mul- tiple simultaneous users. Puget Systems Labs conducted extensive testing of this conguration with Llama-2-70b and Falcon-40b (Fal- con-40b requires less memory space and can run with only two RTX 6000 Ada GPUs.) In addition to running a chat interface, this hard- ware is also suitable for base model ne-tuning within the available GPU memory limits. The Puget Systems Lab team conducted extensive testing of the new AI Training and Inference server utilizing a full set of four NVIDIA RTX 6000 Ada graphics cards. The team tested the system with Meta's Llama-2-70b-chat-hf, using HuggingFace text-genera- tion-inference (TGI) server and HuggingFace ChatUI. The test model used approximately 130GB of video memory (VRAM), and the team conrmed that the system should work well with other LLMs that t within available GPU memory (192GB with four cards installed). R E C O N L A B S : 3 D P R E S S O A I 3 D M O D E L C R E A T I O N T O O L Seonghoon (Vincent) Ban at RECON Labs was showing a new 3D scanning service called 3Dpresso at SIGGRAPH 2023. While at rst glance it just looked like a 3D object scanning setup, on closer in- spection of the 3D scanned model, I was really impressed. He was getting full color, very detailed 3D scans that were even carrying over ne textures and details, which is actually a lot harder to do than you might think. But I didn't even see a scanner, just a poseable gure in a small white photobooth on a turntable. So when Vincent took out his phone and said you could just shoot one or two minutes of video from multiple angles, then upload it to 3Dpresso, and 30 minutes later it would give you this detailed, tex- tured mesh with no holes or weird geometry, I got excited. When I asked how much this would cost, he said $1 per scan. This has applications for creating great 3D digital assets created from real world objects as well as a lot of uses in the 3D printing world. If I get as good of results as he did, I'm sure I will be using the tool a lot. — Heath Firestone S H U T T E R S T O C K : G E N E R A T I V E A I 3 D S C E N E B A C K G R O U N D T O O L Nvidia founder and CEO Jensen Huang announced an expanded