Bids Are Invited For Project Smart Star: Ai Solution For Ai Server Infrastructure

The Government Of Alberta’S Department Of Technology And Innovation Is Seeking A Contractor To Deliver A Solution, Consisting Of Software, Ai Models And Engineering Services, Deployed On The Province’S Artificial Intelligence (Ai) Server Infrastructure. The Scope Of Services Does Not Include The Procurement And Installation Of The Physical Hardware And/Or Cloud Infrastructure. The Successful Solution Will Support A Broad Range Of Public Sector Use Cases. Use Cases May Include Fraud Detection In Student Loan Processing, Summarization Of Financial Agreements, And Analysis Of Archival Records.The Proposed Solution Will Leverage The Province’S Existing Compute Ai Server Infrastructure Consisting Of A Cluster Of 32 Nvidia H100s Gpus With An Aggregate Capacity:• Total Gpu Memory: 2,560 Gb (2.5 Tb) Hbm3,• Total Memory Bandwidth: 107.2 Tb/S,• Peak Fp16 Compute (No Sparsity): 63,328 Tflops (63.3 Pflops),• Peak Fp8 Compute (Sparse): 126,000+ Tflops (126 Pflops), And• Inter-Gpu Bandwidth (Nvlink): 28.8 Tb/S Total Potential (Assuming Full Mesh/Topology Support),That Will Support The Development, Deployment And Continuous Operation Of Multiple Large Language Models (Llms), Including Open Source And Closed Sourced Models.