News from the AI industry and academia; AI-related updates such as new papers, new models, or new services from big tech companies including OpenAI, Google, DeepMind, Meta, and Amazon; news on big deals between AI companies (acquisitions, partnerships); news about large-scale foundation models; and news about major talent acquisitions by big tech companies.
vLLM separates HTTP handling and tokenization from GPU inference using AsyncLLM and EngineCore.
A continuous batching scheduler groups tokens from multiple requests into each forward pass to maximize GPU utilization.
The KVCacheManager stores transformer attention keys and values in fixed‐size GPU memory blocks for efficient reuse.
+2 more insights
There are two email formats—plain text and HTML—with many technical communities strongly preferring plain text.
A curated list of email clients that compose plain text by default with correct quoting and wrapping settings is provided.
Detailed setup instructions are given for popular email clients to enable plain text composing and bottom posting.
+3 more insights
The US Copyright Office currently has no confirmed leader after the abrupt firing of Register Shira Perlmutter and Librarian of Congress Carla Hayden.
A legal dispute centers on whether the president has the authority to remove and appoint the Register of Copyrights and Librarian of Congress.
Justice Department officials attempted to install a new Acting Register, but they never formally assumed the role or returned to the office.
+3 more insights
Facebook is prompting users to allow Meta AI access to private photos in their camera roll.
If users opt in, Facebook will upload photos to its servers for cloud processing to suggest AI-edited versions like collages, recaps, restylings, or themes.
By agreeing, users accept Meta’s AI Terms, permitting analysis of their media and facial features and retention of personal information to personalize AI outputs.
+3 more insights
The bound on BB(6) has grown from 10^36,534 to an iterated exponentiation tower of height 15 with base 10.
Mxdys improved the bound to an iterated exponentiation tower of ten million 10s, with a Coq-verified proof.
A further update shows BB(6) is at least 2 tetrated three levels deep ending in 9, equivalent to 2 pentated to 5.
+2 more insights
Deno’s fraud claim against Oracle for submitting a Node.js website screenshot was dismissed by the TTAB.
Deno disagrees with the dismissal and is focusing on genericness and abandonment claims instead of fraud.
They argue that “JavaScript” is a generic programming language name, not an Oracle product.
+2 more insights
Social platforms follow a cycle: pure intentions, venture funding, growth imperative, algorithmic manipulation, and mission corruption.
Addiction is engineered by incentives that prioritize engagement metrics and time-on-platform for profit.
Individual strategies like digital detoxes can’t overcome systematic platform manipulation targeting psychological vulnerabilities.
+2 more insights
A student project at University of Tokyo designed a custom RISC CPU on FPGA and built a homegrown C compiler from scratch.
A joint team (Group X) aimed to port MIT’s educational Unix-like OS Xv6 onto their custom CPU, requiring new toolchain and CPU features.
They created Ucc, a C89 compiler in OCaml, and enhanced their simulator to support interrupts and virtual memory with hardware page walking.
+3 more insights
MCP is a standardized way to connect not just AI but any tool to data sources.
Like USB-C ports, MCP opens a wide possibility space for many unexpected uses.
Shared MCP servers create a universal plugin ecosystem usable by all apps.
+2 more insights
Twenty-seven previously unheard compositions by Erik Satie have been discovered and are set to premiere a century after his death.
British musicologist James Nye and Japanese composer Sato Matsui found these works in Satie’s small notebooks held in archives like the Bibliothèque Nationale de France.
Most pieces were sketched by Satie during his time playing piano in Montmartre bistros and while walking between Paris and his home in Arcueil.
+3 more insights