Granite 3.1 Language Models
Collection
A series of language models with 128K context length trained by IBM licensed under Apache 2.0 license.
•
9 items
•
Updated
•
58
Csaba Kecskemeti PRO
csabakecskemeti
AI & ML interests
None yet
Recent Activity
updated
a model
about 8 hours ago
DevQuasar/homebrewltd.Ichigo-llama3.1-8B-v0.5-GGUF
replied to
their
post
about 8 hours ago
Testing Training on AMD/ROCm the first time!
I've got my hands on an AMD Instinct MI100. It's about the same price used as a V100 but on paper has more TOPS (V100 14TOPS vs MI100 23TOPS) also the HBM has faster clock so the memory bandwidth is 1.2TB/s.
For quantized inference it's a beast (MI50 was also surprisingly fast)
For LORA training with this quick test I could not make the bnb config works so I'm running the FT on the fill size model.
Will share all the install, setup and setting I've learned in a blog post, together with the cooling shroud 3D design.
Organizations
csabakecskemeti's activity
upvoted
a
collection
2 months ago
upvoted
an
article
8 months ago
Article
Merge Large Language Models with mergekit
By
•
•
94
upvoted
an
article
9 months ago
Article
Decoding GPT-4'o': In-Depth Exploration of Its Mechanisms and Creating Similar AI.
By
•
•
35