Intel Gaudi2

Driver installing

1. Install Ubuntu 24.02 LTS
   1. Pre-requisites
      1. UPDATE OS: sudo apt update && apt upgrade
      2. GENERAL: sudo apt install -y curl gnupg pciutils wget
      3. VLLM: sudo apt-get install python3-pip
      4. vENV: sudo apt install python3.12-venv
2. Install driver
   1. See: https://docs.habana.ai/en/latest/Installation_Guide/Driver_Installation.html
   2. Commands:

      wget -nv https://vault.habana.ai/artifactory/gaudi-installer/1.24.1/habanalabs-installer.sh
      chmod +x habanalabs-installer.sh
      ./habanalabs-installer.sh install --type base
      

3. Setup tpc llvm ( https://github.com/powderluv/tpc_llvm )
   1. Commands:

      git clone https://github.com/HabanaAI/tpc_llvm.git tpc-llvm
      
      mkdir build ; cd build ; CC=gcc-13 CXX=g++-13 CXXFLAGS="-include cstdint" cmake --build . --target all -j1
      cmake --install . --prefix "$HOME/dist"
      

4. something; pip install -r gaudi-pytorch-bridge/requirements.txt