CLIP-ViT-g-14-laion2B-s34B-b88K
| Property | Value |
|---|---|
| License | MIT |
| Training Dataset | LAION-2B (English subset) |
| ImageNet Accuracy | 78.4% (Zero-shot) |
| Training Samples | 34.5B |
What is CLIP-ViT-g-14-laion2B-s34B-b88K?
This is an advanced CLIP (Contrastive Language-Image Pre-training) model implementing a Vision Transformer (ViT) architecture. Trained on the LAION-2B English dataset subset, it represents a significant achievement in zero-shot image classification and multi-modal learning. The model was trained through a collaborative effort between Jülich Supercomputing Center and stability.ai, utilizing substantial computational resources.
Implementation Details
The model was trained with impressive specifications: 34.5B samples over 256 checkpoints, using a global batch size of 88,800 across 1,480 GPUs. The training procedure employed a learning rate of 1e-3 with cosine annealing scheduling and weight decay of 0.2. Notable technical parameters include a 13.5k step warmup period and a local batch size of 60.
- Extensive training on LAION-2B English dataset
- Optimized ViT-g/14 architecture
- High-performance distributed training setup
- Advanced learning rate scheduling
Core Capabilities
- Zero-shot image classification
- Image and text retrieval
- Cross-modal understanding
- Transfer learning foundation
- Image classification fine-tuning
Frequently Asked Questions
Q: What makes this model unique?
This model stands out for its exceptional zero-shot classification performance (78.4% on ImageNet-1k) and its massive training scale using the LAION-2B dataset. It represents a significant advancement in vision-language models trained on publicly available data.
Q: What are the recommended use cases?
The model excels in research applications, particularly zero-shot image classification, image-text retrieval, and as a foundation for transfer learning. However, it's important to note that deployment in production environments is currently out of scope, and the model is primarily intended for research purposes.
