I am trying to ingest an AI tool for my website, which catalogs AI tools. Here is the content from the landing page of https://furiosa.ai, enclosed in braces: { FuriosaAIㅤ FuriosaAI Get notified first about RNGD Sign up Products AI Accelerators Mask group

Gen 2 — RNGD For LLM and Multimodality Warboyonhand bg

Gen 1 — Vision NPU For Computer Vision Developer Experience Furiosa SDK Model Zoo Dev Support Identity & Access Manager (IAM) Blog Newsroom About Careers Contact AI Accelerators Mask group

Gen 2 — RNGD For LLM and Multimodality Warboyonhand bg

Gen 1 — Vision NPU For Computer Vision Developer Experience Furiosa SDK Model Zoo Dev Support Identity & Access Manager (IAM) Blog Newsroom About Careers Contact Frontpage

Furiosa RNGD - Gen 2 data center accelerator Powerfully efficient AI inference for enterprise and cloud View specs Get notified first E F F I C I E N T L L M I N F E R E N C E ‎Efficiency (tokens/watt) 3 8b h100

‎Efficiency ‎(tokens/watt) 3 8b l40s

Llama 3 8B 2048 input tokens / 2048 output tokens rngd FuriosaSDK / FP8 / 3047 tokens/s h100 sxm TensorRT-LLM 0.11.0 / FP8 / 8399 tokens/s l40s TensorRT-LLM 0.11.0 / FP8 / 1912 tokens/s Efficiency (queries/watt) GPT J H100

Efficiency (queries/watt) GPT J l40s

GPT-J MLPerf data center, closed, offline scenario / 99.9% accuracy rngd FuriosaSDK / FP8 / 15.13 queries/s h100 sxm TensorRT-LLM 0.11.0 / FP8 / 30.375 queries/s l40s TensorRT-LLM 0.11.0 / FP8 / 12.25 queries/s RNGD H100 SXM L40S Technology TSMC 5nm TSMC 4nm TSMC 5nm BF16/FP8 (TFLOPS) 256/512 989/1979 362/733 INT8/INT4 (TOPS) 512/1024 1979/- 733/733 Memory capacity (GB) 48 80 48 Memory bandwidth (TB/s) 1.5 3.35 0.86 Host I/F Gen5 x16 Gen5 x16 Gen4 x16 TDP (W) 150 700 350 Disclaimer: Measurements by FuriosaAI internally on current specifications and/or internal engineering calculations. Nvidia results were retrieved from Nvidia website, /perf-overview.md, on Aug 25, 2024. https://github.com/NVIDIA/Tens... INFERENCE WITHOUT CONSTRAINTS Performance Deploy the most capable models with low latency and high throughput Efficiency Lower total cost of ownership with less energy, fewer racks, and air-cooled data centers of today Programmability Stay future-proof for tomorrow’s models and transition with ease Learn more about RNGD EFFICIENT AI INFERENCE IS HERE Rev01 front

RNGD (pronounced "Renegade") delivers high-performance LLM and multimodal deployment capabilities while maintaining a radically efficient 150W power profile. 512TFLOPS 64TFLOPS (FP8) x 8 processing elements 48GB HBM3 memory capacity 2 x HBM3 CoWoS-S, 6.0Gbps 256MB SRAM 384TB/s on-chip bandwidth 1.5TB/s HBM3 memory bandwidth 150W TDP Targeting air-cooled data centers PCIe P2P support for LLM BF16, FP8, INT8, INT4 support Multiple-instance and virtualization Secure boot & model encryption Tensor contraction, not matmul

Tensor Contraction Processor (TCP) At the heart of Furiosa RNGD is Tensor Contraction Processor architecture (ISCA 2024), specifically designed for efficient tensor contraction operations. The fundamental computation of modern day deep learning is tensor contraction, a higher dimensional generalization of matrix multiplication. However, most commercial deep learning accelerators today incorporate fixed-sized matmul instructions as primitives. RNGD breaks away from that, unlocking powerful performance and efficiency. Download TCP Paper Learn more about TCP Tensor Contraction Processor

TCP is the compute architecture underlying Furiosa accelerators. With tensor operation as the first-class citizen, Tensor Contraction Processor (TCP) unlocks unparalleled energy efficiency. Tensor mapping for max utilization

We elevate the programming interface between hardware and software to treat tensor contraction as a single, unified operation. This fundamental design choice streamlines programming, maximizing parallelism and data reuse, while providing flexibility and reconfigurability of compute and maximizes memory resources based on tensor shapes. Furiosa Compiler leverages this flexibility and reconfigurability of hardware to select the most optimized tactics, delivering powerful and efficient deep learning acceleration for all scales of deployment. SOFTWARE FOR LLM DEPLOYMENT Furiosa SW Stack consists of a model compressor, serving framework, runtime, compiler, profiler, debugger, and a suite of APIs for ease of programming and deployment. Coming soon publicly in 2025. Fai sw Stack cubes 5 RGB 1

Built for advanced inference deployment Comprehensive software toolkit for optimizing large language models on RNGD. User-friendly APIs facilitate seamless state-of-the-art LLM deployment. Maximizing data center utilization Ensure higher utilization and flexibility for small and large deployments with containerization, SR-IOV, Kubernetes, as well as other cloud native components. Robust ecosystem support Effortlessly deploy models from library to end-user with PyTorch 2.x integration. Leverage the vast advancements of open-source AI and seamlessly transition models into production. Series RNGD R N G D 2025 RNGD-S Fai RGND series outlines RNGDS

Leadership performance for creatives, media and entertainment, and video AI Q3 2024 RNGD Fai RGND series outlines RNGD Default

150W versatile inference for all infrastructure deployments 2025 RNGD-MAX Fai RGND series outlines RNGD Max

350W powerful inference with maximum compute density Blackbg

BE IN THE KNOW Sign up to be notified first about RNGD availability and product updates. Sign up Blog See all posts

Why we’re joining the UEC: The future of LLM inference is multi-chip News Systolic array vs TCP hero

Is Furiosa’s chip architecture actually innovative? Or just a fancy systolic array? Technical Updates

Gartner report mentions FuriosaAI as Sample Vendor, highlights need for power-efficient AI chips News See all posts Company About us Blog Newsroom Careers Contact AI Accelerators Gen 2 — RNGD for LLM and Multimodality Gen 1 — Vision NPU for Computer Vision Developer Experience Furiosa SDK Model Zoo Dev Support on Jira Identity & Access Manager (IAM) Privacy Policy Copyright 2024 FuriosaAI Get the latest from Furiosa AI Sign up for news, announcements, and more. First name Last name Organization name Job title Location Select an option Afghanistan Albania Algeria American Samoa Andorra Angola Anguilla Antarctica Antigua & Barbuda Argentina Armenia Aruba Australia Austria Azerbaijan Bahamas Bahrain Bangladesh Barbados Belarus Belgium Belize Benin Bermuda Bhutan Bolivia Bosnia Botswana Bouvet Island Brazil British Indian Ocean Territory British Virgin Islands Brunei Bulgaria Burkina Faso Burundi Cambodia Cameroon Canada Cape Verde Caribbean Netherlands Cayman Islands Central African Republic Chad Chile China Christmas Island Cocos (Keeling) Islands Colombia Comoros Congo - Brazzaville Congo - Kinshasa Cook Islands Costa Rica Croatia Cuba Curaçao Cyprus Czechia Côte d’Ivoire Denmark Djibouti Dominica Dominican Republic Ecuador Egypt El Salvador Equatorial Guinea Eritrea Estonia Eswatini Ethiopia Falkland Islands Faroe Islands Fiji Finland France French Guiana French Polynesia French Southern Territories Gabon Gambia Georgia Germany Ghana Gibraltar Greece Greenland Grenada Guadeloupe Guam Guatemala Guernsey Guinea Guinea-Bissau Guyana Haiti Heard & McDonald Islands Honduras Hong Kong Hungary Iceland India Indonesia Iran Iraq Ireland Isle of Man Israel Italy Jamaica Japan Jersey Jordan Kazakhstan Kenya Kiribati Kuwait Kyrgyzstan Laos Latvia Lebanon Lesotho Liberia Libya Liechtenstein Lithuania Luxembourg Macau Madagascar Malawi Malaysia Maldives Mali Malta Marshall Islands Martinique Mauritania Mauritius Mayotte Mexico Micronesia Moldova Monaco Mongolia Montenegro Montserrat Morocco Mozambique Myanmar Namibia Nauru Nepal Netherlands New Caledonia New Zealand Nicaragua Niger Nigeria Niue Norfolk Island North Korea North Macedonia Northern Mariana Islands Norway Oman Pakistan Palau Palestine Panama Papua New Guinea Paraguay Peru Philippines Pitcairn Islands Poland Portugal Puerto Rico Qatar Romania Russia Rwanda Réunion Samoa San Marino Saudi Arabia Senegal Serbia Seychelles Sierra Leone Singapore Sint Maarten Slovakia Slovenia Solomon Islands Somalia South Africa South Georgia & South Sandwich Islands South Korea South Sudan Spain Sri Lanka St. Barthélemy St. Helena St. Kitts & Nevis St. Lucia St. Martin St. Pierre & Miquelon St. Vincent & Grenadines Sudan Suriname Svalbard & Jan Mayen Sweden Switzerland Syria São Tomé & Príncipe Taiwan Tajikistan Tanzania Thailand Timor-Leste Togo Tokelau Tonga Trinidad & Tobago Tunisia Turkiye Turkmenistan Turks & Caicos Islands Tuvalu U.S. Outlying Islands U.S. Virgin Islands UK US Uganda Ukraine United Arab Emirates Uruguay Uzbekistan Vanuatu Vatican City Venezuela Vietnam Wallis & Futuna Western Sahara Yemen Zambia Zimbabwe Åland Islands Email Address * Leave this field blank Submit Cancel About FuriosaAI Get notified first about RNGD Sign up Products AI Accelerators Mask group

Gen 2 — RNGD For LLM and Multimodality Warboyonhand bg

Gen 1 — Vision NPU For Computer Vision Developer Experience Furiosa SDK Model Zoo Dev Support Identity & Access Manager (IAM) Blog Newsroom About Careers Contact AI Accelerators Mask group

Gen 2 — RNGD For LLM and Multimodality Warboyonhand bg

Gen 1 — Vision NPU For Computer Vision Developer Experience Furiosa SDK Model Zoo Dev Support Identity & Access Manager (IAM) Blog Newsroom About Careers Contact About

Our mission is to build AI chips capable of running the world's most advanced models efficiently. We believe this is a critical lever in making AI computing more sustainable for the next generation. Learn about our latest product 2024 Gen 2 data center accelerator RNGD (TSMC 5nm) unveils 2023 Gen 1 Vision NPU official volume production with Samsung Foundry and ASUS 2022– Global ecosystem partnership with Hugging Face, Samsung, SK Hynix, TSMC, ASUS, LG AI Research 2022 Commercial enterprise and public cloud deployment with Kakao 2021 First AI chip startup to outperform Nvidia on MLPerf Inference 2021 Gen 1 Vision NPU (Samsung 14nm) launches 2017 R&D begins in Seoul

Join us in creating the world's most advanced AI chips See open roles Company About us Blog Newsroom Careers Contact AI Accelerators Gen 2 — RNGD for LLM and Multimodality Gen 1 — Vision NPU for Computer Vision Developer Experience Furiosa SDK Model Zoo Dev Support on Jira Identity & Access Manager (IAM) Privacy Policy Copyright 2024 FuriosaAI Get the latest from Furiosa AI Sign up for news, announcements, and more. First name Last name Organization name Job title Location Select an option Afghanistan Albania Algeria American Samoa Andorra Angola Anguilla Antarctica Antigua & Barbuda Argentina Armenia Aruba Australia Austria Azerbaijan Bahamas Bahrain Bangladesh Barbados Belarus Belgium Belize Benin Bermuda Bhutan Bolivia Bosnia Botswana Bouvet Island Brazil British Indian Ocean Territory British Virgin Islands Brunei Bulgaria Burkina Faso Burundi Cambodia Cameroon Canada Cape Verde Caribbean Netherlands Cayman Islands Central African Republic Chad Chile China Christmas Island Cocos (Keeling) Islands Colombia Comoros Congo - Brazzaville Congo - Kinshasa Cook Islands Costa Rica Croatia Cuba Curaçao Cyprus Czechia Côte d’Ivoire Denmark Djibouti Dominica Dominican Republic Ecuador Egypt El Salvador Equatorial Guinea Eritrea Estonia Eswatini Ethiopia Falkland Islands Faroe Islands Fiji Finland France French Guiana French Polynesia French Southern Territories Gabon Gambia Georgia Germany Ghana Gibraltar Greece Greenland Grenada Guadeloupe Guam Guatemala Guernsey Guinea Guinea-Bissau Guyana Haiti Heard & McDonald Islands Honduras Hong Kong Hungary Iceland India Indonesia Iran Iraq Ireland Isle of Man Israel Italy Jamaica Japan Jersey Jordan Kazakhstan Kenya Kiribati Kuwait Kyrgyzstan Laos Latvia Lebanon Lesotho Liberia Libya Liechtenstein Lithuania Luxembourg Macau Madagascar Malawi Malaysia Maldives Mali Malta Marshall Islands Martinique Mauritania Mauritius Mayotte Mexico Micronesia Moldova Monaco Mongolia Montenegro Montserrat Morocco Mozambique Myanmar Namibia Nauru Nepal Netherlands New Caledonia New Zealand Nicaragua Niger Nigeria Niue Norfolk Island North Korea North Macedonia Northern Mariana Islands Norway Oman Pakistan Palau Palestine Panama Papua New Guinea Paraguay Peru Philippines Pitcairn Islands Poland Portugal Puerto Rico Qatar Romania Russia Rwanda Réunion Samoa San Marino Saudi Arabia Senegal Serbia Seychelles Sierra Leone Singapore Sint Maarten Slovakia Slovenia Solomon Islands Somalia South Africa South Georgia & South Sandwich Islands South Korea South Sudan Spain Sri Lanka St. Barthélemy St. Helena St. Kitts & Nevis St. Lucia St. Martin St. Pierre & Miquelon St. Vincent & Grenadines Sudan Suriname Svalbard & Jan Mayen Sweden Switzerland Syria São Tomé & Príncipe Taiwan Tajikistan Tanzania Thailand Timor-Leste Togo Tokelau Tonga Trinidad & Tobago Tunisia Turkiye Turkmenistan Turks & Caicos Islands Tuvalu U.S. Outlying Islands U.S. Virgin Islands UK US Uganda Ukraine United Arab Emirates Uruguay Uzbekistan Vanuatu Vatican City Venezuela Vietnam Wallis & Futuna Western Sahara Yemen Zambia Zimbabwe Åland Islands Email Address * Leave this field blank Submit Cancel Join us in building the future of AI FuriosaAI Get notified first about RNGD Sign up Products AI Accelerators Mask group

Gen 2 — RNGD For LLM and Multimodality Warboyonhand bg

Gen 1 — Vision NPU For Computer Vision Developer Experience Furiosa SDK Model Zoo Dev Support Identity & Access Manager (IAM) Blog Newsroom About Careers Contact AI Accelerators Mask group

Gen 2 — RNGD For LLM and Multimodality Warboyonhand bg

Gen 1 — Vision NPU For Computer Vision Developer Experience Furiosa SDK Model Zoo Dev Support Identity & Access Manager (IAM) Blog Newsroom About Careers Contact Join us in building the future of AI

We came together to really reinvent AI computing from the ground up and at every level. – Hanjoon, Furiosa CTO Furiosa Way Shared vision Since day 1, our hardware and software team have worked together as a single team toward a shared vision. Fierce execution We execute fiercely towards the bold vision we set for ourselves. Show, don't tell We disregard hype or self-promotion. Instead we let our products and results speak. Furiosa Worldwide To build a formidable team, we embrace a global mindset, allowing us to attract top talent without constraints. Korea HQ Our R&D headquarters was established in 2017 in Seoul where we've been fortunate to leverage Korea’s robust semiconductor and tech innovation ecosystem US HQ Our North American hub is based in Santa Clara, California but our U.S. employees and advisors are represented across the States. Germany HQ FuriosaAI welcomes a new hub in Germany to begin research and partnership initiatives in Europe 4f6273a1349b71382287247289f3fa20

Open roles Browse through all our open roles, or reach out to us to inquire about a role. contact@furiosa.ai Integrated Marketing Manager Seoul, South Korea or San Francisco Bay Area, CA Content Strategist San Francisco Bay Area, CA or Seoul, South Korea Algorithm - Software Engineer (Model Compression Tool) Seoul, South Korea Algorithm - Research Engineer (LLM Serving and Acceleration) Seoul, South Korea Algorithm - Research Engineer Internship (LLM Inference) Seoul, South Korea Business - BD&Sales, APAC Team Seoul, South Korea Business - Finance Manager Seoul, South Korea Business - 경영관리 담당자 Seoul, South Korea Product - AI Developer Advocate San Francisco Bay Area, CA (preferred) Product - Field Application Engineer Seoul, South Korea (On-site) Product - Technical Program Manager Seoul, South Korea (On-site) HR - Tech Recruiter Seoul, South Korea Tech Sales - Solution Architect Seoul, South Korea Software - Compiler Engineer Seoul, South Korea Software - Platform Engineer Seoul, South Korea Software - Cloud Infrastructure Engineer Seoul, South Korea Software - Software Engineer, Containers and Kubernetes Seoul, South Korea Software - Software Engineer (AI Frameworks Integration) Seoul, South Korea Software - DevOps (CI/CD) Engineer Seoul, South Korea System SW - System Software Engineer Seoul, South Korea System SW - Software Engineer, Drivers/Runtime (Windows) Seoul, South Korea Hardware - AI Chip Architect Seoul, South Korea Hardware - SoC Design Engineer Seoul, South Korea Hardware - Design Verification Engineer Seoul, South Korea Hardware - High Speed Interface(IO) Design Engineer Seoul, South Korea Hardware - Senior HW System Engineer Seoul, South Korea Hardware - Signal/Power Integrity Engineer Seoul, South Korea Company About us Blog Newsroom Careers Contact AI Accelerators Gen 2 — RNGD for LLM and Multimodality Gen 1 — Vision NPU for Computer Vision Developer Experience Furiosa SDK Model Zoo Dev Support on Jira Identity & Access Manager (IAM) Privacy Policy Copyright 2024 FuriosaAI Get the latest from Furiosa AI Sign up for news, announcements, and more. First name Last name Organization name Job title Location Select an option Afghanistan Albania Algeria American Samoa Andorra Angola Anguilla Antarctica Antigua & Barbuda Argentina Armenia Aruba Australia Austria Azerbaijan Bahamas Bahrain Bangladesh Barbados Belarus Belgium Belize Benin Bermuda Bhutan Bolivia Bosnia Botswana Bouvet Island Brazil British Indian Ocean Territory British Virgin Islands Brunei Bulgaria Burkina Faso Burundi Cambodia Cameroon Canada Cape Verde Caribbean Netherlands Cayman Islands Central African Republic Chad Chile China Christmas Island Cocos (Keeling) Islands Colombia Comoros Congo - Brazzaville Congo - Kinshasa Cook Islands Costa Rica Croatia Cuba Curaçao Cyprus Czechia Côte d’Ivoire Denmark Djibouti Dominica Dominican Republic Ecuador Egypt El Salvador Equatorial Guinea Eritrea Estonia Eswatini Ethiopia Falkland Islands Faroe Islands Fiji Finland France French Guiana French Polynesia French Southern Territories Gabon Gambia Georgia Germany Ghana Gibraltar Greece Greenland Grenada Guadeloupe Guam Guatemala Guernsey Guinea Guinea-Bissau Guyana Haiti Heard & McDonald Islands Honduras Hong Kong Hungary Iceland India Indonesia Iran Iraq Ireland Isle of Man Israel Italy Jamaica Japan Jersey Jordan Kazakhstan Kenya Kiribati Kuwait Kyrgyzstan Laos Latvia Lebanon Lesotho Liberia Libya Liechtenstein Lithuania Luxembourg Macau Madagascar Malawi Malaysia Maldives Mali Malta Marshall Islands Martinique Mauritania Mauritius Mayotte Mexico Micronesia Moldova Monaco Mongolia Montenegro Montserrat Morocco Mozambique Myanmar Namibia Nauru Nepal Netherlands New Caledonia New Zealand Nicaragua Niger Nigeria Niue Norfolk Island North Korea North Macedonia Northern Mariana Islands Norway Oman Pakistan Palau Palestine Panama Papua New Guinea Paraguay Peru Philippines Pitcairn Islands Poland Portugal Puerto Rico Qatar Romania Russia Rwanda Réunion Samoa San Marino Saudi Arabia Senegal Serbia Seychelles Sierra Leone Singapore Sint Maarten Slovakia Slovenia Solomon Islands Somalia South Africa South Georgia & South Sandwich Islands South Korea South Sudan Spain Sri Lanka St. Barthélemy St. Helena St. Kitts & Nevis St. Lucia St. Martin St. Pierre & Miquelon St. Vincent & Grenadines Sudan Suriname Svalbard & Jan Mayen Sweden Switzerland Syria São Tomé & Príncipe Taiwan Tajikistan Tanzania Thailand Timor-Leste Togo Tokelau Tonga Trinidad & Tobago Tunisia Turkiye Turkmenistan Turks & Caicos Islands Tuvalu U.S. Outlying Islands U.S. Virgin Islands UK US Uganda Ukraine United Arab Emirates Uruguay Uzbekistan Vanuatu Vatican City Venezuela Vietnam Wallis & Futuna Western Sahara Yemen Zambia Zimbabwe Åland Islands Email Address * Leave this field blank