CRITICAL//Consensus

Nick Land, Machnic Desire from Fanged Noumena

Edgerunners

Links for 2024-12-23

AI:

1. What o3 Becomes by 2028 — “We haven't seen AIs made from compute optimal LLMs pretrained on these systems yet, but the systems were around for 6+ months, so the AIs should start getting deployed imminently, and will become ubiquitous in 2025.” https://www.lesswrong.com/posts/NXTkEiaLA4JdS5vSZ/what-o3-becomes-by-2028

2. Orienting to 3 year AGI timelines https://www.lesswrong.com/posts/jb4bBdeEEeypNkqzj/orienting-to-3-year-agi-timelines

3. “AI that exceeds human performance in nearly every cognitive domain is almost certain to be built and deployed in the next few years. We need to act accordingly now.” https://milesbrundage.substack.com/p/times-up-for-ai-policy

4. The new hyped Genesis simulator is up to 10x slower, not 10-80x faster https://stoneztao.substack.com/p/the-new-hyped-genesis-simulator-is

5. Stanford researchers introduced a new system that can generate physically plausible human-object interactions from natural language https://hoifhli.github.io/

6. “We analyzed 18 LLMs and found units mirroring the brain's language, theory of mind, and multiple demand networks!” https://arxiv.org/abs/2411.02280

7. A biologically-inspired hierarchical convolutional energy model predicts V4 responses to natural videos https://www.biorxiv.org/content/10.1101/2024.12.16.628781v1

8. LlamaFusion: Adapting Pretrained Language Models for Multimodal Generation https://arxiv.org/abs/2412.15188

9. Memory Layers at Scale https://arxiv.org/abs/2412.09764

10. Deliberative alignment: reasoning enables safer language models https://openai.com/index/deliberative-alignment/

11. A foundation model for generalizable disease detection from retinal images https://www.nature.com/articles/s41586-023-06555-x

12. Prompting Depth Anything for 4K Resolution Accurate Metric Depth Estimation https://promptda.github.io/

13. ⇆ Marigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusion https://marigolddepthcompletion.github.io/

14. Startup’s autonomous drones precisely track warehouse inventories https://news.mit.edu/2024/corvus-autonomous-drones-precisely-track-warehouse-inventories-1220

15. MIT engineers developed AI frameworks to identify evidence-driven hypotheses that could advance biologically inspired materials. https://news.mit.edu/2024/need-research-hypothesis-ask-ai-1219

16. Anthropic co-founder Jack Clark says when he and Dario Amodei went to the White House in 2023 where Kamala Harris told them, "We've got our eye on you guys. AI is going to be a really big deal and we're now actually paying attention" https://youtu.be/om2lIWXLLN4?si=ySlUNtsBzZVe7Tc-&t=705

17. UN Secretary-General Antonio Guterres tells the UN Security Council that technology will never move in the future as slowly as today https://x.com/tsarnick/status/1871016318247604624

Technology:

1. Aqueous Homogeneous Miniature Reactors Could Supply U.S. Bases With Unlimited Fuel https://www.forbes.com/sites/davidhambling/2024/12/05/miniature-reactors-could-supply-us-bases-with-unlimited-fuel/

2. A Billion Times Faster: Laser Neurons Ignite the Future of AI https://opg.optica.org/optica/fulltext.cfm?uri=optica-11-12-1690&id=565919

3. MIT engineers grow “high-rise” 3D chips https://news.mit.edu/2024/mit-engineers-grow-high-rise-3d-chips-1218

Math:

1. Tarski's high school algebra problem inquires whether all identities involving addition, multiplication, and exponentiation over the positive integers can be derived solely from a specific set of eleven axioms commonly taught in high school mathematics. https://en.wikipedia.org/wiki/Tarski%27s_high_school_algebra_problem

2. Mathematicians Uncover a New Way to Count Prime Numbers https://www.quantamagazine.org/mathematicians-uncover-a-new-way-to-count-prime-numbers-20241211/

Miscellaneous:

1. Game-Changing Dual Cancer Therapy Completely Eradicates Tumors Without Harsh Side Effects https://news.mit.edu/2024/implantable-microparticles-can-deliver-two-cancer-therapies-1028

2. Are most of senescent cells immune cells? https://www.nature.com/articles/s12276-024-01354-4

It never ceases to amaze me how much progress has been made in the last few years.

Original source: https://www.youtube.com/watch?v=ctWfv4WUp2I

GHOST, 2024

onespeg

Akira 💊

Architecture and cityscapes from Katsuhiro Otomo’s “Akira”

8 лютого 1993 року!

Links for 2024-11-30

AI:

1. Alibaba takes on OpenAI's o1 with new "Reasoning" AI model QwQ: Reflect Deeply on the Boundaries of the Unknown (32B beats O1 mini and competes with O1 preview) https://www.lesswrong.com/posts/eM77Zz8fTMcGpk6qo/new-o1-like-model-qwq-beats-claude-3-5-sonnet-with-only-32b [Terence Tao says QwQ seems to be significantly better at MO problems than previous open source models https://mathstodon.xyz/@tao/113568284621180843]

2. Eric Schmidt says he has been shocked recently by how quickly China are catching up to the US in AI and that the "threat escalation matrix" goes up with each level of improvement in the technology https://youtu.be/AjgwIRPnb_M?si=omP4RanS1PXKgGOk&t=1592

3. “most people don't know that the original research on scaling laws came from Baidu in 2017 – not OpenAI in 2020” https://x.com/jxmnop/status/1861473014673797411

4. A Revolution in How Robots Learn https://www.newyorker.com/magazine/2024/12/02/a-revolution-in-how-robots-learn [no paywall: https://archive.is/JVbJS]

5. Do you want to teach your robot with one demo, then sit back and watch it instantly perform that task? Instant Policy https://www.robot-learning.uk/instant-policy

6. Genomic Bottleneck Algorithm "...performs tasks like image recognition almost as effectively as state-of-the-art AI." https://www.cshl.edu/the-next-evolution-of-ai-begins-with-ours/

7. Star Attention: Efficient LLM Inference over Long Sequences https://arxiv.org/abs/2411.17116

8. Beyond Examples: High-level Automated Reasoning Paradigm in In-Context Learning via MCTS https://arxiv.org/abs/2411.18478

9. Predicting Emergent Capabilities by Finetuning — “We find that our emergence law can accurately predict the point of emergence up to 4x the FLOPs in advance.” https://arxiv.org/abs/2411.16035

10. A Foundation Model for the Earth System: “Aurora outperforms operational forecasts for air quality, ocean waves, tropical cyclone tracks, and high-resolution weather forecasting at orders of magnitude smaller computational expense than dedicated existing systems.” https://arxiv.org/abs/2405.13063

11. Announcing Agent Graph System — a new approach to multi-step agent tool use, improving GPT-4o success rate by 4x https://xpander.ai/2024/11/20/announcing-agent-graph-system/

12. OpenAI board chair Bret Taylor says there will be continuous improvement in the quality of AI for the foreseeable future because there are 3 independent areas in which progress can be made and "the likelihood that something stalls out is very low" https://youtu.be/U5HrbLHk0w4?si=iQy272t-BduEKe3H&t=296

13. Yann LeCun joins Sam Altman and Demis Hassabis in estimating AGI within the next 5-10 years. https://youtu.be/JAgHUDhaTU0?si=98ITctEctok0tVC9&t=4481

14. “We present an automatic framework to identify, interpret and steer neurons within LMM for safe AGI” https://arxiv.org/abs/2411.14982

15. Estimates of GPU or equivalent resources of large AI players for 2024/5 https://www.lesswrong.com/posts/bdQhzQsHjNrQp7cNS/estimates-of-gpu-or-equivalent-resources-of-large-ai-players

16. A machine learning study has found that the political leanings of economists not only influence the language they use to present their results in academic research, but also the very estimates they produce for several “objective” variables, such that the implied policy prescription is consistent with their partisan leaning. https://academic.oup.com/ej/article/134/662/2439/7659819

17. A new golden age of discovery https://deepmind.google/public-policy/ai-for-science/

18. “Aphantasia is a fascinating variation in human cognitive experience and may gesture toward the future success of multimodal AI technology.” https://hollisrobbinsanecdotal.substack.com/p/aphantasia-and-mental-modeling

19. OpenAI’s GPT-4o Makes AI Clones of Real People With Surprising Ease https://singularityhub.com/2024/11/29/openais-gpt-4o-makes-ai-clones-of-real-people-with-surprising-ease/

20. chatgpt voice as a real-time universal translator https://x.com/ky__zo/status/1861870413699272948

ᴇɴᴅ ᴡᴏʀʟᴅꜱ, 2024

onespeg

🔗

HYPER-RACISM

From the Cyberpunk tabletop RPG (1988)

CCRU Anime Opening

NEW - A church in Switzerland is now using an AI hologram of Jesus to take confessions from worshippers.

https://www.disclose.tv/id/z33eqyr1bv/

@disclosetv

NEW - Figure robotics say "autonomous fleets" are here.

@disclosetv

Waifu.ch 🌺

Cyberpunk landscapes by Dana Ulama

US government commission pushes Manhattan Project-style AI initiative

Read more: https://www.reuters.com/technology/artificial-intelligence/us-government-commission-pushes-manhattan-project-style-ai-initiative-2024-11-19/

No paywall: https://archive.is/oFSsZ

Download the report here: https://www.uscc.gov/annual-report/2024-annual-report-congress

Links for 2024-11-18

AI:

1. Gwern on diminishing returns to scaling and AI in China https://www.reddit.com/r/slatestarcodex/comments/1gsv897/gwern_on_the_diminishing_returns_to_scaling_and/

2. Training LLM agents via «embodied» exploration in their native environment – with short programs as motor commands. https://minihf.com/posts/2024-11-03-weave-agent-dev-log-2/

3. Interpretable Contrastive Monte Carlo Tree Search Reasoning https://arxiv.org/abs/2410.01707

4. AI is now designing chips for AI https://bigthink.com/the-future/ai-is-now-designing-chips-for-ai/

5. Stanford researchers introduced Virtual Lab, an AI system where LLM agents collaborate as research teams https://www.biorxiv.org/content/10.1101/2024.11.11.623004v1

6. XBOW's security AI finds a previously unknown bug in Scoold https://xbow.com/blog/xbow-scoold-vuln/

7. Study Finds ChatGPT Outperforms Doctors at Diagnosing Illness — Human doctors: 74%; Human doctors using ChatGPT: 76%; ChatGPT alone: 90% https://www.nytimes.com/2024/11/17/health/chatgpt-ai-doctors-diagnosis.html [no paywall: https://archive.is/TmdRq]

8. Now anyone in LA can hail a Waymo robotaxi https://techcrunch.com/2024/11/12/now-anyone-in-la-can-hail-a-waymo-robotaxi/

9. Trump Team Is Seeking to Ease US Rules for Self-Driving Cars https://www.bloomberg.com/news/articles/2024-11-17/trump-team-said-to-want-to-ease-us-rules-for-self-driving-cars [no paywall: https://archive.is/S9qOq]

10. LLaVA-o1: Let Vision Language Models Reason Step-by-Step https://arxiv.org/abs/2411.10440

11. Nvidia presents LLaMA-Mesh: Unifying 3D Mesh Generation with Language Models https://research.nvidia.com/labs/toronto-ai/LLaMA-Mesh/

12. How to create a rational LLM-based agent? using game-theoretic workflow! https://arxiv.org/abs/2411.05990

13. Emergence of Hidden Capabilities: Exploring Learning Dynamics in Concept Space https://arxiv.org/abs/2406.19370

14. The Dawn of GUI Agent: A Preliminary Case Study with Claude 3.5 Computer Use https://arxiv.org/abs/2411.10323

15. AI models opened up to US defense https://spectrum.ieee.org/ai-used-by-military

16. NASA & Microsoft unveiled Earth Copilot, an AI that answers simple questions about satellite data. https://www.youtube.com/watch?v=YJs6kU4BtR4&t=1s

17. Scaling Laws for Pre-training Agents and World Models https://arxiv.org/abs/2411.04434

Technology:

1. Design of facilitated dissociation enables control over cytokine signaling duration https://www.biorxiv.org/content/10.1101/2024.11.15.623900v1

2. Really doing mechanics at the quantum level https://nanoscale.blogspot.com/2024/11/really-doing-mechanics-at-quantum-level.html

3. Nuclear Power Was Once Shunned at Climate Talks. Now, It’s a Rising Star. https://www.nytimes.com/2024/11/15/climate/cop29-climate-nuclear-power.html [no paywall: https://archive.is/H9rr3]

Brain:

1. “Could long-term memories theoretically be extracted from the static structure of a preserved brain? In our new pre-print, we find the typical neuroscientist thinks there's about a 40% chance it could be done.” https://osf.io/preprints/psyarxiv/keq7w

2. “…even a von Neumann only had slightly better genes than everyone else, probably no more than a few hundred. Hence, anyone who does get thousands of extra good variants will be many SDs beyond what we currently see.” https://gwern.net/embryo-selection

Miscellaneous:

1. That orange streak is Mercury with its glowing sodium plasma tail, passing in front of the Pleiades cluster. https://spaceweathergallery.com/indiv_upload.php?upload_id=184299

2. “Show a typical economist a theory article, and watch how he ‘reads’ it: He reads the abstract and introduction, flips the theory pages, then reads the conclusion. If math is so enlightening, why do even the mathematically able routinely skip the math?” https://www.betonit.ai/p/economath_failshtml

3. “0.00385% of New York's population were responsible for 33% of the shoplifting arrests in the city.” https://x.com/cremieuxrecueil/status/1858243351234986401

We need jungle I'm afraid

NEW - First artwork by humanoid robot sells for over $1.0 million

READ: https://t.co/sijYf1YcL4

Follow @InsiderPaper for more news

Atom Cyber

Links for 2024-11-12


AI:

1. This study says it achieved human-level scores on the ARC challenge with LLMs using Test-Time Training (TTT). Can TTT combined with LLMs be enough to achieve abstract reasoning? https://ekinakyurek.github.io/papers/ttt.pdf [code: https://github.com/ekinakyurek/marc]

2. People underestimate how powerful test-time compute is: compute for longer, in parallel, or fork and branch arbitrarily—like cloning your mind 1,000 times and picking the best thoughts. https://www.tylerhouchin.com/blogs/entering-the-inference-era/

3. Improving semantic understanding in speech language models via brain-tuning — Speech models like Whisper can be improved by fine-tuning on brain data (fMRI collected by listening to podcasts). https://arxiv.org/abs/2410.09230

4. ManipGen: a sim2real agent for zero-shot manipulation. ManipGen handles complex tasks in the real world like organizing shelves, tidying cluttered tables, and more – all from text input and with on human demonstrations! https://mihdalal.github.io/manipgen/

5. Kinetix: an open-ended universe of physics-based tasks for RL https://kinetix-env.github.io/

6. Lucid V1:A world model that can emulate Minecraft environments in real-time on consumer hardware! https://ramimo.substack.com/p/lucid-v1-a-world-model-that-does

7. Dualformer: Controllable Fast and Slow Thinking by Learning with Randomized Reasoning Traces https://arxiv.org/abs/2410.09918

8. Dreaming Out Loud: A Self-Synthesis Approach For Training Vision-Language Models With Developmentally Plausible Data https://arxiv.org/abs/2411.00828

9. Researchers say the path to wise AIs runs through metacognition https://arxiv.org/abs/2411.02478

10. Can AI models collectively match human forecasting abilities in predicting real-world events? The LLM ensemble outperformed the 50% baseline with a Brier score of 0.20 vs 0.25, matched human crowd accuracy (0.19 Brier score) with no statistically significant difference, showed 61% of predictions above the 50th percentile, and demonstrated significant forecast improvements of 17-28% when exposed to human median predictions, with prediction intervals narrowing from 17.75 to 14.22 for GPT-4 and 11.67 to 8.28 for Claude 2. https://www.science.org/doi/10.1126/sciadv.adp1528

11. OpenAI's Kevin Weil says AI models "are going to get smarter at an accelerating rate" with voice and translation at a "magical" level already and vision to come https://youtu.be/IxkvVZua28k?si=0nJsYDyqDRCARPuk&t=2126

Prediction markets:

1. Google difficulties in forecasting LLMs using a internal prediction market https://asteriskmag.com/issues/08/the-death-and-life-of-prediction-markets-at-google

2.The Online Sports Gambling Experiment Has Failed https://www.lesswrong.com/posts/tHiB8jLocbPLagYDZ/the-online-sports-gambling-experiment-has-failed

Health:

1. "James Fickel has dedicated $200 million he made betting on Ether to becoming one of the world’s biggest investors in" longevity & neuroscience https://www.bloomberg.com/news/articles/2024-11-11/crypto-millionaire-fuels-push-to-transform-brain-research [no paywall: https://archive.is/VhxMU]

2. When muscles work out, they help neurons to grow, a new study shows https://news.mit.edu/2024/when-muscles-work-out-they-help-neurons-grow-1112

3. What Ketamine Therapy Is Like https://www.lesswrong.com/posts/zgAws2AoFE3adigvy/what-ketamine-therapy-is-like

Technology:

1. "Neural Networks (MNIST inference) on the “3-cent” Microcontroller" (90% MNIST in 1 kiloword) https://cpldcpu.wordpress.com/2024/05/02/machine-learning-mnist-inference-on-the-3-cent-microcontroller/

2. Shocking New Memory Tech: Crystal-to-Glass Transformation Using a Billion Times Less Energy https://iisc.ac.in/events/self-shocks-turn-crystal-to-glass-at-ultralow-power-density/

Space:

1. “The radio source ASKAP J1935+2148 is an amazing thing…It could be a really weird pulsar, but nobody knows how a pulsar spinning so slowly could put out radio waves.” https://mathstodon.xyz/@johncarlosbaez/113460684713479446

Dario Amodei, CEO of Anthropic, in an interview with Lex Friedman:

- In the unlikely scenario where we proceed in a straight line without bottlenecks on data, compute, or energy, we could reach AGI in the next few years. 2026 or 2027.

- AI models are on a trajectory to surpass human reasoning and performance at professional tasks: "if we extrapolate the straight curve within a few years, we will get to these models being above the highest professional level of humans"

- $100 billion AI data centers will be built by 2027 and he is bullish about powerful AI happening soon because we are starting to reach PhD-level intelligence

Watch the whole interview: https://youtu.be/ugvHCXCOmm4?si=fAy9LQvUTgB5olbJ

Read the transcript: https://lexfridman.com/dario-amodei-transcript/

Onespeg

Links for 2024-11-10

AI:

1. LLMs Look Increasingly Like General Reasoners: “I believe the new evidence should update all of us toward LLMs scaling straight to AGI, and therefore toward timelines being relatively short.” https://www.lesswrong.com/posts/wN4oWB4xhiiHJF9bS/llms-look-increasingly-like-general-reasoners

2. “VLMs can act as generative universal value functions. We discovered a simple method to generate zero-shot and few-shot values for 300+ robot tasks and 50+ datasets using SOTA VLMs like Gemini” https://generative-value-learning.github.io/

3. Geometry-Informed Neural Networks are evolving! Beyond faster training and improved shapes, GINNs surprised us with an emergent property – a structured latent space. https://arturs-berzins.github.io/GINN/

4. Dextrous Code Generation: Generating Robot Policy Code for High-Precision and Contact-Rich Manipulation Tasks https://dex-code-gen.github.io/dex-code-gen/

5. Groq CEO Jonathan Ross says generative AI is so powerful because it benefits from increasing compute to find solutions buried in search trees that otherwise wouldn't be found and which give AIs their intuition https://youtu.be/KhLXVRiZBdo?si=WOv5ZzclpGJlTJEr&t=575

6. Why AI Could Eat Quantum Computing’s Lunch https://www.technologyreview.com/2024/11/07/1106730/why-ai-could-eat-quantum-computings-lunch/ [no paywall: https://archive.is/R6kaY]

7. Why could a coding model trained on just 2.5T tokens compete with top-tier models like DeepSeekCoder (10T tokens) and QwenCoder (15T tokens)? https://opencoder-llm.github.io/

8. Debate May Help AI Models Converge on Truth https://www.quantamagazine.org/debate-may-help-ai-models-converge-on-truth-20241108/

9. “I don't see signs of these capability increases stopping or slowing down, and if they do continue I expect the impact on society to start accelerating as they exceed what an increasing fraction of humans can do. I think we could see serious changes in the next 2-5 years.” https://www.lesswrong.com/posts/CNA8ksMwcuXHPjXRt/personal-ai-planning

Health:

1. Three people with severely impaired vision who received stem-cell transplants have experienced substantial improvements in their sight https://www.nature.com/articles/d41586-024-03656-z

2. A ‘Crazy’ Idea for Treating Autoimmune Diseases Might Actually Work https://www.theatlantic.com/health/archive/2024/11/lupus-car-t-immune-reset-autoimmune-disease/680521/ [no paywall: https://archive.is/keEBa]

Political forecasting:

1. Polling by asking people about their neighbors: When does this work? Should people be doing more of it? And the connection to that French dude who bet on Trump https://statmodeling.stat.columbia.edu/2024/11/09/polling-by-asking-people-about-their-neighbors-when-does-this-work/

2. “…one election—or even several national elections—does not supply enough data to distinguish the performance of probabilistic forecasts that are so similar to each other.” https://statmodeling.stat.columbia.edu/2024/11/10/prediction-markets-in-2024-and-poll-aggregation-in-2008/

Miscellaneous:

1. “For decades, astrophysicists have been saying dark matter can't be mostly black holes. But this may be wrong: new calculations suggest up to 100% of dark matter could be black holes, about as heavy as asteroids, that formed in the very early universe.” https://mathstodon.xyz/@johncarlosbaez/113454218813011168

2. China’s Libertarian Medical City? https://marginalrevolution.com/marginalrevolution/2024/11/chinas-libertarian-medical-city.html

😎

Elon Musk
"The Neuralink implant itself could eventually cost around $1,000–$2,000 with high production.

The surgery, done by a robot, would be quick—our goal is a 10-minute, 600-second procedure.

All-inclusive, it could be priced similarly to LASIK, around $5,000."

SG🇸🇬 Transhumanism, AI and Technocracy
Channel🔗 | Discussion🔗

Boo

ep.1, 2024

Rui Huang

Cyberpunk City - Lucy's Rooftop by E-Hsuan

behind the scenes of Akira (1988)

Its because Japan and England are linked on a spiritual level.

Links for 2024-10-24

AI:

1. Global power demand for AI data centers could grow by more than 130 GW by 2030. https://ifp.org/future-of-ai-compute/

2. New SOTA for theorem proving model: InternLM2.5-StepProver and its critic, setting a new minif2f SOTA at 65.9%. No hallucination, verified math proofs by LLM reasoning. https://arxiv.org/abs/2410.15700

3. miniCTX, a new benchmark that tests a model's ability to prove theorems from complex, real Lean projects https://cmu-l3.github.io/minictx/

4. New follow-up work on the effects of synthetic data on model pre-training. It’s becoming increasingly clear that the model collapse issues predicted by prior works are not panning out in theory and practice. https://arxiv.org/abs/2410.16713

5. A Comparative Study on Reasoning Patterns of OpenAI's o1 Model https://arxiv.org/abs/2410.13639

6. A Theoretical Understanding of Chain-of-Thought: Coherent Reasoning and Error-Aware Demonstration https://arxiv.org/abs/2410.16540

7. Evaluating and enhancing probabilistic reasoning in language models https://research.google/blog/evaluating-and-enhancing-probabilistic-reasoning-in-language-models/

8. Multi-Agent AI and GPU-Powered Innovation in Sound-to-Text Technology https://developer.nvidia.com/blog/multi-agent-ai-and-gpu-powered-innovation-in-sound-to-text-technology/

9. "SimpleAutomation": You spend $200 on a robot, use a special joystick to control it, and do the tasks you need. After 10 minutes of examples, your tireless autonomous assistant is ready. https://github.com/1g0rrr/SimpleAutomation

10. LLMD: A Large Language Model for Interpreting Longitudinal Medical Records https://arxiv.org/abs/2410.12860

11. Microsoft CEO Satya Nadella says AI development is being optimized by OpenAI's o1 model and has entered a recursive phase https://youtu.be/kOkDTvsUuWA?si=PwvicSLriSR5nmbN&t=1865

12. Demis Hassabis says DeepMind's drug discovery spinoff Isomorphic will have drug treatments in the clinic in a couple of years tackling "six big areas of health" https://www.ft.com/content/72d2c2b1-493b-4520-ae10-41c1a7f3b7e4 [no paywall: https://archive.is/Nbx7M]

13. ChatGPT o1-preview can code Stan https://statmodeling.stat.columbia.edu/2024/10/22/chatgpt-o1-preview-can-code-stan/

14. “ChatGPT-O1 Changes Programming as a Profession. I really hated saying that.” https://www.youtube.com/watch?app=desktop&v=j0yKLumIbaM

15. Progress towards real-time generation from multimodal models https://openai.com/index/simplifying-stabilizing-and-scaling-continuous-time-consistency-models/

16. Musk and xAI pulled off a feat that usually takes four years, setting up a supercluster of 100,000 H200 GPUs in just 19 days. Nvidia's Jensen Huang called the effort "superhuman,". https://www.tomshardware.com/pc-components/gpus/elon-musk-took-19-days-to-set-up-100-000-nvidia-h200-gpus-process-normally-takes-4-years

17. Generating Distinct AI Voice Performances By Prompt Engineering GPT-4o https://minimaxir.com/2024/10/speech-prompt-engineering/

18. ETH Zurich researchers showcase a method using YOLO models to bypass reCAPTCHAv2 with 100% accuracy https://arxiv.org/abs/2409.08831

Technology:

1. Science Corporation, a leader in brain-computer interface (“BCI”) technology, has announced the preliminary clinical trials results for its PRIMA retinal implant. https://science.xyz/news/primavera-trial-preliminary-results/

2. Thermodynamic modeling to optimize the shape of a beer glass to keep it cold for the longest time. https://www.arxiv.org/abs/2410.12043

3. Solar transpiration–powered lithium extraction and storage https://techxplore.com/news/2024-10-solar-powered-lithium-brine.html

Science:

1. The insane capabilities of fish in tests of memory, learning, and problem-solving. https://80000hours.org/podcast/episodes/sebastien-moro-fish-cognition-senses-social-lives/

2. A substantial reduction of Alzheimers disease associated with semaglutide (Ozempic) in > 1 million people with Type 2 diabetes from a nationwide data resource https://alz-journals.onlinelibrary.wiley.com/doi/10.1002/alz.14313

https://www.newscientist.com/article/2452876-dna-has-been-modified-to-make-it-store-data-350-times-faster/

Links for 2024-10-21

AI:

1. GenRM, an iterative algorithm that trains an LLM on self-generated reasoning traces, leading to synthetic preference labels matching human preference judgments https://arxiv.org/abs/2410.12832

2. Meta's Joe Spisak explains how AI models can train themselves by generating images, asking itself questions about them, and choosing the best answers, in order to move beyond human data and human fine-tuning, and teach itself from synthetic data https://youtu.be/QS7C3ZCI8Dw?si=yt7fFMuVoQc-TAf1&t=595

3. Robots can learn skills from YouTube without complex video processing. https://arxiv.org/abs/2410.09286

4. OKAMI: Teaching Humanoid Robots Manipulation Skills through Single Video Imitation https://ut-austin-rpl.github.io/OKAMI/

5. Researchers developed DIAMOND, an AI model that can generate a playable simulation of Counter-Strike at 10 fps within a neural network. https://diamond-wm.github.io/

6. OpenAI's Noam Brown says the new o1 model beats GPT-4o at math and code, and "these numbers, I can almost guarantee you, are going to go up over the next year or two" https://www.youtube.com/live/Gr_eYXdHFis?si=bCO09axuwC6_4Cn9&t=1329

7. Solving complex problems with OpenAI o1 models https://openai.com/business/solving-complex-problems-with-openai-o1-models/

8. Now Anyone Can Code: How AI Agents Can Build Your Whole App https://www.youtube.com/watch?v=jbIQfoldLag

9. Microsoft announces new autonomous agent capabilities across Copilot Studio and Dynamics 365. Agents will be capable of asynchronous orchestration of complex tasks over long time periods, and will independently learn and improve from memory. https://blogs.microsoft.com/blog/2024/10/21/new-autonomous-agents-scale-your-team-like-never-before/

10. OpenAI CPO Kevin Weil says the o1 reasoning model is only at the GPT-2 level so it will improve very quickly as they are only at the beginning of scaling the inference-time compute paradigm, and by the time competitors catch up to o1, they will be 3 steps ahead https://youtu.be/VsmEMUiPXIs?si=bwXhBdkSqMU2rrrQ&t=1159

11. Is addition all you need? This paper replaces a lot of LLM floating point multiplications with integer additions and the models still work but are 5-20x more computationally efficient. https://arxiv.org/abs/2410.00907

12. US Treasury Says AI Tools Prevented $1 Billion of Fraud in 2024 https://gizmodo.com/us-treasury-says-ai-tools-prevented-1-billion-of-fraud-in-2024-2000513080

13. San Francisco techies are loving Self-Driving Cars. Waymo is currently serving over 100,000 paid rides a week. https://www.wsj.com/tech/waymo-san-francisco-self-driving-robotaxis-uber-244feecf [no paywall: https://archive.is/Wo5wm]

Technology:

1. Why does the connectome seem to have so little relationship to neural activity in C elegant? https://www.biorxiv.org/content/10.1101/2024.09.22.614271v1

2. Computer simulations point the way towards better solar cells https://www.chalmers.se/en/current/news/f-computer-simulations-point-the-way-towards-better-solar-cells/

3. Ultra-Deep Fracking for Limitless Geothermal Power Is Possible: EPFL https://newatlas.com/energy/fracking-key-geothermal-power/

4. It’s Time to Build the Exoplanet Telescope https://www.palladiummag.com/2024/10/18/its-time-to-build-the-exoplanet-telescope/

Psychology:

1. Does learning music improve cognitive abilities? According to this new meta-analysis, the answer is yes! During chilhood and for a specific capacity: Inhibitory control. https://www.sciencedirect.com/science/article/abs/pii/S0010027724001999

2. Finland's baby bust extends to historically large Laestadian families https://yle.fi/a/74-20086218

3. Eight out of 10 South Koreans aged 19 to 34 viewed South Korea as “a hell,” while 7.5 out of 10 said they hoped to leave. https://english.hani.co.kr/arti/english_edition/e_national/922522.html

Miscellaneous:

1. The “Hubble tension”: A growing crisis in cosmology https://mathscholar.org/2024/10/the-hubble-tension-a-growing-crisis-in-cosmology/

Links for 2024-10-18


AI:

1. Transformers can be trained to solve a 132-years old open problem: discovering global Lyapunov functions. https://arxiv.org/abs/2410.08304

2. DeepSeek is introducing Janus: a revolutionary autoregressive framework for multimodal AI! By decoupling visual encoding and unifying them with a single transformer, it outperforms previous models in both understanding and generation. https://arxiv.org/abs/2410.13848

3. nGPT: A hypersphere-based Transformer achieving 4-20x faster training and improved stability for LLMs. https://arxiv.org/abs/2410.01131

4. Google presents Inference Scaling for Long-Context Retrieval Augmented Generation — Finds that increasing inference computation leads to nearly linear gains in RAG perf when optimally allocated. https://arxiv.org/abs/2410.04343

5. A method to learn from internet-scale videos without action labels https://latentactionpretraining.github.io/

6. Combining next-token prediction and video diffusion in computer vision and robotics https://news.mit.edu/2024/combining-next-token-prediction-video-diffusion-computer-vision-robotics-1016

7. TopoLM: brain-like spatio-functional organization in a topographic language model https://arxiv.org/abs/2410.11516

8. The most compelling single-neuron evidence for the existence of a generative model in the human brain https://www.biorxiv.org/content/10.1101/2024.10.05.616828v2.abstract

9. Looking Inward: Language Models Can Learn About Themselves by Introspection https://arxiv.org/abs/2410.13787

10. Google Deepmind trained a grandmaster-level transformer chess player that achieves 2895 ELO, even on chess puzzles it has never seen before, with zero planning, by only predicting the next best move. https://arxiv.org/abs/2402.04494

11. Evidence of Learned Look-Ahead in a Chess-Playing Neural Network? https://www.lesswrong.com/posts/hPGw7hWYbYyvDcqYK/evidence-against-learned-search-in-a-chess-playing-neural

12.The Premise of a New S-Curve in AI https://tomtunguz.com/elo-improvement/

13. Sam Altman says the most important piece of knowledge discovered in his lifetime was that scaling AI models leads to unbelievable, predictable improvements in intelligence and he wondered if he was crazy or in a cult when he tried to explain it to others and they didn't understand https://youtu.be/FVRHTWWEIz4?si=dvOzjcfwL1ZR-lVM&t=1226

14. Researchers from Google and UoW propose a new collaborative search algorithm to adapt LLM via swarm intelligence. https://arxiv.org/abs/2410.11163

15. Agent S is a new open agentic framework that enables autonomous interaction with computers through a GUI. https://arxiv.org/abs/2410.08164v1

16. Boston Dynamics and Toyota announced a partnership to accelerate the development of general-purpose humanoid robots https://pressroom.toyota.com/boston-dynamics-and-toyota-research-institute-announce-partnership-to-advance-robotics-research/

17. No Slowdown At TSMC, Thanks To The AI Gold Rush https://www.nextplatform.com/2024/10/17/no-slowdown-at-tsmc-thanks-to-the-ai-gold-rush/

18. U.S. Special Operations Command is seeking the ability to create AI-generated social media users https://theintercept.com/2024/10/17/pentagon-ai-deepfake-internet-users/

19. AI Mathematical Olympiad - Progress Prize 2 https://www.kaggle.com/competitions/ai-mathematical-olympiad-progress-prize-2

Science:

1. “The galaxies were never supposed to be so bright. They were never supposed to be so big. And yet there they are—oddly large, luminous objects that keep appearing in images taken by the James Webb Space Telescope” https://www.quantamagazine.org/the-beautiful-confusion-of-the-first-billion-years-comes-into-view-20241009/

2. Owning a video game console may improve mental health. A natural Experiment: Due to a shortage, Japanese retailers allocated consoles to customers by lottery https://www.nature.com/articles/s41562-024-01948-y

3. Butterfly species’ big brains adapted giving them a survival edge, study finds https://www.sciencedaily.com/releases/2023/07/230712203752.htm

The Ghost in the Shell: Fully Compiled (повна колекція у твердій палітурці)

🔗

«LAZARUS» нове оригінальне аніме

Режисер Шінічіро Ватанабе з Чадом Стахельскі (Джон Вік) як екшн-постановник.

Студія MAPPA Production

13 епізодів.

Прем'єра в 2025 році на Adult Swim.

I WANT THE OPPOSITE OF TED K. I WANT MORE TECH I WANT TO RULE THE STARS AND THE EARTH. GREATNESS IS WITHIN OUR GRASP IF ONLY WE HAD THE WILL TO DO IT

How Quantum Search Works — A Clear and Simple Demonstration

EDGE. Subscribe.

Вот он: яркий и цветастый неоновый киберпанк!
Ночи в китайском городе Циндао
Cyberdelia #technology

Onespeg

Josan Gonzalez

THEY CAN'T KEEP GETTING AWAY WITH IT

https://www.darkhorsedirect.com/products/cyberpunk-edgerunners-the-final-moment-premium-statue

Demis Hassabis says it is wrong to think of AI as being just another technology; he says it will be "epochal defining" and will soon cure all diseases, solve climate and energy problems and enrich our lives

Original source: https://x.com/GoogleDeepMind/status/1846974292963066199