Reading
BloomBench is a cognition-driven bilingual (English-Arabic) multimodal benchmark that organizes tasks according to Bloom's Revised Taxonomy, evaluating the multimodal reasoning capabilities of vision-language models (VLMs) across six cognitive levels from Remember to Create.
Section 01
BloomBench is a cognition-driven bilingual (English-Arabic) multimodal benchmark that organizes tasks according to Bloom's Revised Taxonomy, evaluating the multimodal reasoning capabilities of vision-language models (VLMs) across six cognitive levels from Remember to Create.
Section 02
Most existing vision-language model (VLM) benchmarks focus on accuracy or headline scores for isolated tasks, making it difficult to reveal the true cognitive-level capability distribution of models. BloomBench is designed to change this situation—it systematically evaluates the multimodal reasoning capabilities of VLMs from a cognitive science perspective, based on Bloom's Revised Taxonomy.
Core Design Principles:
Section 03
BloomBench organizes evaluation tasks according to the six levels of Bloom's Taxonomy:
Section 04
Capabilities at the recognition and recall level:
Section 05
Comprehension of combinations and relationships:
Section 06
Applying knowledge in new visual contexts:
Section 07
Decomposition and reasoning:
Section 08
Judgment and decision-making:
Keep going with more reads from the same topic.
Splinter is a minimalist, high-performance key-value (KV) and vector storage system enabling zero-latency inter-process communication via shared memory and atomic operations. With only 766 lines of core code, it supports millions of operations per second and 768-dimensional vector storage, offering a new architectural approach for local LLM inference and data-intensive applications.
LiteMind is a Python framework that provides developers with a unified API to integrate mainstream LLM providers such as OpenAI, Anthropic, Google Gemini, and Ollama. It supports multimodal input/output, tool calling, RAG enhancement, and agent construction.
OmniRoute is an open-source AI gateway that integrates over 67 large model providers through a single OpenAI-compatible endpoint. It offers intelligent routing, load balancing, automatic degradation, and quota management, helping developers get the most available AI services at the lowest cost.
This article introduces an open-source multimodal RAG framework based on Google Gemini Embedding 2, which can uniformly handle embedding and retrieval of four media types: text, images, videos, and audio. Combined with Supabase pgvector vector database and OpenRouter large language models, it provides a complete production-level retrieval-augmented generation pipeline.