datascientology | Education

Telegram-канал datascientology - Data Scientology

1234

Hot data science related posts every hour. Chat: https://telegram.me/r_channels Contacts: @lgyanf

Subscribe to a channel

Data Scientology

AlphaEvolve: A Coding Agent for Scientific and Algorithmic Discovery | Google DeepMind White Paper

**Research Paper:**

* **Blog Post**: [AlphaEvolve: A Gemini-Powered Coding Agent for Designing Advanced Algorithms](https://deepmind.google/discover/blog/alphaevolve-a-gemini-powered-coding-agent-for-designing-advanced-algorithms/)
* **White Paper**: [AlphaEvolve: A Coding Agent for Scientific and Algorithmic Discovery | Google DeepMind White Paper](https://macro.com/app/pdf/35647fcc-191e-4cdf-8d64-e8d862140dfa)

**Main Findings:**

* **Matrix Multiplication Breakthrough:** AlphaEvolve revolutionizes matrix multiplication algorithms by discovering new tensor decompositions that achieve lower ranks than previously known solutions, including surpassing Strassen's 56-year-old algorithm for 4×4 matrices. The approach uniquely combines LLM-guided code generation with automated evaluation to explore the vast algorithmic design space, yielding mathematically provable improvements with significant implications for computational efficiency.
* **Mathematical Discovery Engine:** Mathematical discovery becomes systematized through AlphaEvolve's application across dozens of open problems, yielding improvements on approximately 20% of challenges attempted. The system's success spans diverse branches of mathematics, creating better bounds for autocorrelation inequalities, refining uncertainty principles, improving the Erdős minimum overlap problem, and enhancing sphere packing arrangements in high-dimensional spaces.
* **Data Center Optimization:** Google's data center resource utilization gains measurable improvements through AlphaEvolve's development of a scheduling heuristic that recovers 0.7% of fleet-wide compute resources. The deployed solution stands out not only for performance but also for interpretability and debuggability—factors that led engineers to choose AlphaEvolve over less transparent deep reinforcement learning approaches for mission-critical infrastructure.
* **AI Model Training Acceleration:** Training large models like Gemini becomes more efficient through AlphaEvolve's automated optimization of tiling strategies for matrix multiplication kernels, reducing overall training time by approximately 1%. The automation represents a dramatic acceleration of the development cycle, transforming months of specialized engineering effort into days of automated experimentation while simultaneously producing superior results that serve real production workloads.
* **Hardware-Compiler Co-optimization:** Hardware and compiler stack optimization benefit from AlphaEvolve's ability to directly refine RTL circuit designs and transform compiler-generated intermediate representations. The resulting improvements include simplified arithmetic circuits for TPUs and substantial speedups for transformer attention mechanisms (32% kernel improvement and 15% preprocessing gains), demonstrating how AI-guided evolution can optimize systems across different abstraction levels of the computing stack.

/r/computervision
https://redd.it/1krnp0n

Читать полностью…

Data Scientology

Strange phenomenon with trainning yolov5s

/r/deeplearning
https://redd.it/1kl8m50

Читать полностью…

Data Scientology

AI Workstation for €15,000–€20,000 – 4× RTX 4090 Worth It?

Hey everyone,

I'm currently planning to build a high-end system for AI/ML purposes with a budget of around €15,000 to €20,000. The goal is to get maximum AI compute power locally (LLMs, deep learning, inference, maybe some light fine-tuning), without relying on the cloud.

Here’s the configuration I had in mind:

CPU: AMD Threadripper PRO 7965WX (24 cores, 48 threads)
Motherboard: ASUS Pro WS WRX90E-SAGE SE (sTR5, 7× PCIe 5.0 x16)
RAM: 512 GB ECC DDR5
GPU: 4× NVIDIA RTX 4090 (24 GB GDDR6X each)
Storage: 2× 8TB Seagate Exos
PSU: Corsair AX1600i

I have about 3 months of time to complete the project, so I’m not in a rush and open to waiting for upcoming hardware.

Now, here are my main questions:

1. Does this setup make sense in terms of performance for the budget, or are there better ways to maximize AI performance locally?
2. Would you recommend waiting for 2× RTX 6000 Ada / Blackwell models if long-term stability and future-proofing are priorities?
3. Is 4× RTX 4090 with proper software (Ray, DDP, vLLM, etc.) realistically usable, or will I run into major bottlenecks?
4. Has anyone built a similar system and has experience with thermals or GPU spacing
5. I’d really appreciate any input, suggestions, or feedback from others who’ve done similar builds.

Thanks a lot 🙏

/r/deeplearning
https://redd.it/1kgsazv

Читать полностью…

Data Scientology

How to go about finding the horizon line in the sea?

/r/computervision
https://redd.it/1kcijbh

Читать полностью…

Data Scientology

Such loss curves make me feel good

/r/deeplearning
https://redd.it/1k9oub0

Читать полностью…

Data Scientology

Do I have a chance at ML (CV) PhD?

So I have been thinking for a few months about doing a phd in 3DCV, inverse rendering and ML. I know it is super competitive these days when I see people getting into top schools already have CVPR / ECCV papers. My profile is nowhere close to them however I do have 2 years of research experience (as RA during MS in a good public school in the US) in computer vision and physics as well as my masters thesis/project revolves around SOTA 3D object detection + robotics (perception sim to real). I recently submitted it to IROS (fingers crossed). Did some good CV internships and work as a software engineer at FAANG now.
But again seeing the profiles that get into top schools makes me shit my pants. They have so many papers (even first authored) already. Do I have a chance?

/r/computervision
https://redd.it/1k5kqql

Читать полностью…

Data Scientology

Trying to build computer vision to track ultimate frisbee players… what tools should I use?

https://redd.it/1k0bi9b
@datascientology

Читать полностью…

Data Scientology

I built a biomedical GNN + LLM pipeline (XplainMD) for explainable multi-link prediction

https://redd.it/1jvuz3b
@datascientology

Читать полностью…

Data Scientology

ML Data Linguist Interview - Coding

Hello all, first post here. I'm having a second set of interviews next week for an Amazon ML Data Linguist position after having a successful first phone interview last week. I'll start right away with the problem: I do not know how to code. I made that very clear in the first phone interview but I was still passed on to this next set of interviews, so I must have done/said something right. Anyway, I've done research into how these interviews typically go, and how much knowledge of each section one should have to prepare for these interviews, but I'm just psyching myself out and not feeling very prepared at all.

My question in its simplest form would be: is it possible to get this position with my lack of coding knowledge/skills?

I figured this subreddit would be filled with people with that expertise and wanted to ask advice from professionals, some of whom might be employed in the very position I'm applying for. I really value this opportunity in terms of both my career and my life and can only hope it goes well from here on out. Thanks!

/r/LanguageTechnology
https://redd.it/1jpruz4

Читать полностью…

Data Scientology

D Why is table extraction still not solved by modern multimodal models?

There is a lot of hype around multimodal models, such as Qwen 2.5 VL or Omni, GOT, SmolDocling, etc. I would like to know if others made a similar experience in practice: While they can do impressive things, they still struggle with table extraction, in cases which are straight-forward for humans.

Attached is a simple example, all I need is a reconstruction of the table as a flat CSV, preserving empty all empty cells correctly. Which open source model is able to do that?

https://preview.redd.it/krox7ytlhvre1.png?width=1650&format=png&auto=webp&s=5daa7f68f4acc55f4bdac3b2defa21b9ebfae0d9



/r/MachineLearning
https://redd.it/1jnjfaq

Читать полностью…

Data Scientology

NVidia DGX Spark preorders open, jjust preordered!

/r/deeplearning
https://redd.it/1jeic2l

Читать полностью…

Data Scientology

Simple Tool for Annotating Temporal Events in Videos with Custom Categories

Hey Guys, I built TAAT (Temporal Action Annotation Toolkit),a web-based tool for annotating time-based events in videos. It’s super simple: upload a video, create custom categories like “Human Actions” with subcategories (e.g., “Run,” “Jump”) or “Soccer Events” (e.g., “Foul,” “Goal”), then add timestamps with details. Exports to JSON, has shortcuts (Space to pause,Enter to annotate), and timeline markers for quick navigation.

Main use cases:

Building datasets for temporal action recognition .
Any project needing custom event labels fast.

It’s Python + Flask, uses Video.js for playback, and it’s free on GitHub here. Though this might be helpful for anyone working on video understanding.

https://preview.redd.it/yq6t83tjw3oe1.png?width=1366&format=png&auto=webp&s=c10f5593df671b0c93d539bfe6419770157f28de



/r/computervision
https://redd.it/1j8ybrx

Читать полностью…

Data Scientology

Should I fork and maintain YOLOX and keep it Apache License for everyone?

Latest update was 2022... It is now broken on Google Colab... mmdetection is a pain to install and support. I feel like there is an opportunity to make sure we don't have to use freakin Ultralytics... who's trying to make money on open-source research.

10 YES and I repackage it and keep it up-to-date...

LMK!

/r/computervision
https://redd.it/1izuh6k

Читать полностью…

Data Scientology

YOLOv12: Algorithm, Inference and Custom Data Training
https://youtu.be/1YZDsZL_VyI

/r/computervision
https://redd.it/1itnedo

Читать полностью…

Data Scientology

RT-DETRv2: Is it possible to use it on Smartphones for realtime Object Detection + Tracking?

Any help or hint appreciated.

For a research project I want to create an App (Android preferred) for realtime object detection and tracking. It is about detecting person categorized in adults and children. I need to train with my own dataset.

I know this is possible with Yolo/ultralytics.
However I have to use Open Source with Apache or MIT license only.

I am thinking about using the promising RT-Detr Model (small version) however I have struggles in converting the model into the right format (such as tflite) to be able to use it on an Smartphones.
Is this even possible? Couldn't find any project in this context.

Plan B would be using MediaPipe and its pretrained efficient model with finetuning it with my custom data.

Open for a completely different approach.

So what do you recommend me to do?
Any roadmaps to follow are appreciated.

/r/computervision
https://redd.it/1iqunlw

Читать полностью…

Data Scientology

Motion Capture System with Pose Detection and Ball Tracking

/r/computervision
https://redd.it/1knslv0

Читать полностью…

Data Scientology

Undergraduate Thesis in NLP; need ideas

I'm a rising senior in my university and I was really interested in doing an undergraduate thesis since I plan on attending grad school for ML. I'm looking for ideas that could be interesting and manageable as an undergraduate CS student. So far I was thinking of 2 ideas:

1.  Can cognates from a related high resource language be used during pre training to boost performance on a low resource language model? (I'm also open to any ideas with LRLs). 

2.  Creating a Twitter bot that  detects climate change misinformation in real time, and then automatically generates concise replies with evidence-based facts. 


However, I'm really open to other ideas in NLP that you guys think would be cool. I would slightly prefer a focus on LRLs because my advisor specializes in that, but I'm open to anything.

Any advice is appreciated, thank you!

/r/LanguageTechnology
https://redd.it/1khwzu1

Читать полностью…

Data Scientology

D Self-Promotion Thread

Please post your personal projects, startups, product placements, collaboration needs, blogs etc.

Please mention the payment and pricing requirements for products and services.

Please do not post link shorteners, link aggregator websites , or auto-subscribe links.

\--

Any abuse of trust will lead to bans.

Encourage others who create new posts for questions to post here instead!

Thread will stay alive until next one so keep posting after the date in the title.

\--

Meta: This is an experiment. If the community doesnt like this, we will cancel it. This is to encourage those in the community to promote their work by not spamming the main threads.

/r/MachineLearning
https://redd.it/1kcq3du

Читать полностью…

Data Scientology

Announcing Intel® Geti™ is available now!

/r/computervision
https://redd.it/1kauo4c

Читать полностью…

Data Scientology

Looking for research group

Hey everyone,

I recently published a paper on a new optimizer I’ve been working on called AlphaGrad: [https://arxiv.org/abs/2504.16020](https://arxiv.org/abs/2504.16020) . I’m planning to follow it up with a second paper that includes more experiments, better benchmarks, and a new evolved version of the optimizer.

I did the first version entirely on my own time, but for this next round I’d really love to collaborate. If you’re someone looking to get involved in ML research—whether you’re part of a group or just working solo—I’m open to co-authorship. It’d be awesome to get some fresh perspectives and also speed up the engineering and testing side of things.

A few quick highlights about AlphaGrad:

* It introduces a new update rule using L2 normalization and a smooth tanh transformation
* Performed on par with Adam in off-policy RL environments and outperformed it in on-policy ones (tested on CleanRL)
* I’m currently testing it on GPT2-124M with some promising results that look close to Adam’s behavior
* Also tested it on smaller regression datasets where it did slightly better; now expanding to CIFAR, ResNet, and MNIST
* Targeting to finish up and submit the next paper within the next 2–3 weeks

If this sounds interesting and you’d like to help out or just learn more, feel free to reach out.

/r/deeplearning
https://redd.it/1k72ecv

Читать полностью…

Data Scientology

D Monthly Who's Hiring and Who wants to be Hired?

For Job Postings please use this template

>Hiring: [Location\], Salary:[\], [Remote | Relocation\], [Full Time | Contract | Part Time\] and [Brief overview, what you're looking for\]

For Those looking for jobs please use this template

>Want to be Hired: [Location\], Salary Expectation:[\], [Remote | Relocation\], [Full Time | Contract | Part Time\] Resume: [Link to resume\] and [Brief overview, what you're looking for\]

​

Please remember that this community is geared towards those with experience.

/r/MachineLearning
https://redd.it/1jnt4sp

Читать полностью…

Data Scientology

have some unused compute, giving it away for free!

I have 4 A100s, waiting to go brrrr 🔥 ..... I have some unused compute, so if anyone has any passion project, and the only hinderance is compute, hmu let's get you rolling.

just ask these questions to yourself before:-

\- can your experiment show some preliminary signals in let's say 100 hours of A100s?
\- is this something new? or recreation of some known results? (i would prefer the former)
\- how is this going to make world a better place?

i don't expect you to write more than 2 lines for each of them.

/r/deeplearning
https://redd.it/1jypq8n

Читать полностью…

Data Scientology

Interspeech 2025 Author Review Phase (April 4th)

Just a heads-up that the Author Review phase for Interspeech 2025 starts!!!

Wishing the best to everyone!
Share your experiences or thoughts below — how are your reviews looking? Any surprises?

Let’s support each other through this final stretch!

/r/LanguageTechnology
https://redd.it/1jrh6q8

Читать полностью…

Data Scientology

Part 2: Fork and Maintenance of YOLOX - An Update!

Hi all!

After my post regarding YOLOX: https://www.reddit.com/r/computervision/comments/1izuh6k/should\_i\_fork\_and\_maintain\_yolox\_and\_keep\_it/ a few folks and I have decided to do it!

Here it is: https://github.com/pixeltable/pixeltable-yolox.

I've already engaged with a couple of people from the previous thread who reached out over DMs. If you'd like to get involved, my DMs are open, and you can directly submit an issue, comment, or start a discussion on the repo.

So far, it contains the following changes to the base YOLOX repo:

`pip install`able with all versions of Python (3.9+)
New YoloxProcessor class to simplify inference
Refactored CLI for training and evaluation
Improved test coverage

The following are planned:

CI with regular testing and updates
Typed for use with mypy

This fork will be maintained for the foreseeable future under the Apache-2.0 license.

Install

pip install pixeltable-yolox

Inference

import requests

from PIL import Image

from yolox.models import Yolox, YoloxProcessor

url = "https://raw.githubusercontent.com/pixeltable/pixeltable-yolox/main/tests/data/000000000001.jpg"

image = Image.open(requests.get(url, stream=True).raw)

model = Yolox.from_pretrained("yolox_s")

processor = YoloxProcessor("yolox_s")

tensor = processor([image])

output = model(tensor)

result = processor.postprocess([image], output)

See more in the repo!

/r/computervision
https://redd.it/1jp0o48

Читать полностью…

Data Scientology

Advice on career change

Hi, I’m about to finish my PhD in Linguistics and would like to transition into industry, but I don’t know how realistic it would be with my background.

My Linguistics MA was mostly theoretical. My PhD includes corpus and experimental data, and I’ve learnt to do regression analysis with R to analyse my results. Overall, my background is still pretty formal/theoretical, apart from the data collection and analysis side of it. I also did a 3-month internship in a corpus team, it involved tagging and finding linguistic patterns, but there was no coding involved.

I feel some years ago companies were more interested in hiring linguists (I know linguists who got recruited by apple or google), but nowadays it seems you need to come from coputer science, mahine learning or data science.

What would you advice me to do if I want to transition into insustry after the PhD?

/r/LanguageTechnology
https://redd.it/1jhxxdo

Читать полностью…

Data Scientology

D Self-Promotion Thread

Please post your personal projects, startups, product placements, collaboration needs, blogs etc.

Please mention the payment and pricing requirements for products and services.

Please do not post link shorteners, link aggregator websites , or auto-subscribe links.

\--

Any abuse of trust will lead to bans.

Encourage others who create new posts for questions to post here instead!

Thread will stay alive until next one so keep posting after the date in the title.

\--

Meta: This is an experiment. If the community doesnt like this, we will cancel it. This is to encourage those in the community to promote their work by not spamming the main threads.

/r/MachineLearning
https://redd.it/1j1hc0o

Читать полностью…

Data Scientology

I Just Open-Sourced the Viral Squish Effect! (see comments for workflow & details)

/r/deeplearning
https://redd.it/1j7ny3l

Читать полностью…

Data Scientology

Real world applications of 3D Reconstruction and Vision

With the rapid growth of 3D reconstruction and 3D Vision technologies, I'm very interested in learning about their practical applications across different industries. What business solutions are currently utilizing these techniques effectively? I'm also curious about your imagination of where these technologies might lead us in the future.

I'd appreciate hearing about real-world implementation examples, emerging use cases, and speculative future applications..​​​​​​​​​​​​​​​​

/r/computervision
https://redd.it/1iy2jcn

Читать полностью…

Data Scientology

I suck at programming and I feel so bad

I failed an introductory programming exam (Python) at university and honestly, it made me feel really stupid and inadequate.
I come from a BA in pure linguistics in Germany and I had taken a programming course on Codecademy last year ( still during my BA), but after that, I hadn’t touched Python at all.
Plus, the course at my MSc was terribile, after covering functions it focused almost entirely on regex, which I had never worked with before.

On top of that, I had a lot of other exams to prepare for, so I barely studied and did very little practice. I do enjoy programming—I’ve gone over the “theory” multiple times—but I struggle to remember concepts and apply critical thinking when trying to solve problems. I lack hands-on experience. If you asked me to write even the simplest program, I wouldn’t know where to start.
I mean, at the exam I couldn’t even figure out, recall, how to invert a string or how to join 2 dictionaries…
I had problems in saving a file in Visual studio Code on a different laptop.
I felt so dumb and not suited for this path.
While, most of my colleagues were just great at programming and did fine at the exam.

It feels like I’m just memorizing code rather than truly understanding how to use it.

This whole experience has been pretty discouraging because I know how important programming skills are in this field—especially when there are people with computer science degrees who have been coding since high school.

So now I don’t know where to start. As I said I’ve read the theory multiple times ( how to join dicyionaries, what are functions and hoe they work etv..) bit then if you put me a concrete problem to solbe, even a very dumb one, i dont knkw where to star5t.

That said, I’m currently taking an NLP and ML course at university, which requires basic programming knowledge. So I was thinking of following a hands-on NLP course that also covers regex. That way, I could improve my programming skills while reinforcing what I’m studying now.

Or would it be better to start from the basics of Python again maybe going thru tutorials once again and focusing on practice ?

/r/LanguageTechnology
https://redd.it/1isgphw

Читать полностью…

Data Scientology

NAACL 2025 Decision

The wait is almost over, and I can't contain my excitement for the NAACL 2025 final notifications!

Wishing the best of luck to everyone who submitted their work! Let’s hope for some great news!!!!!

/r/LanguageTechnology
https://redd.it/1i6sbwy

Читать полностью…
Subscribe to a channel