[D] Demystifying distributed checkpointing
https://expertofobsolescence.substack.com/p/demystifying-distributed-checkpointing
/r/MachineLearning
https://redd.it/1gdkdka
How would you handle limits for Free Users without involving stripe?
I'm building the user functionality for my app and want to offer a free tier option with limited capabilities. What's the best way to implement usage restrictions for free users without involving payment processing?
The goals are to:
Allow free users to upload up to 3 photos per month and view up to 10 pages per day
Avoid requiring credit card information upfront, as that may deter signups
Track each free user's usage to enforce the limits
Some options I've considered:
Create a "Free" subscription plan with the desired limits, but set the price to $0. However, this would still prompt for a credit card which I want to avoid.
Add a "paid" boolean field directly to the User model. Set it to false for free users. Then track photo uploads and page views separately without involving subscriptions.
Have a UserUsage model that stores the user's monthly photo uploads and daily page views. Check this on upload/view attempts to enforce limits.
Do you have any other suggestions for tracking free user usage and limits without payment processing involved?
/r/django
https://redd.it/1gdza2x
Advice Needed: Developing AI-Driven International Flight Planner for College Project – API Suggestions?
I’m working on my semester-end project, which is an AI-driven International Flight Planner. The goal is to help users find the best flight options tailored to their preferences (budget, airline, layovers, etc.), while also providing useful travel info like visa requirements, layover accommodation suggestions, and booking recommendations based on past pricing trends.
Would really appreciate any input on API selection, as well as any insights on tech stack choices for a project like this. Thanks in advance!
I’m using Django for the backend and considering PostgreSQL for storing flight data. However, I’m still looking into APIs that can provide reliable flight and travel data. I’m especially interested in APIs with a free tier or trial access since this is a college project.
/r/djangolearning
https://redd.it/1gclql4
I made a guide on how to debug python using ipdb
I tried to make it as straight to the point as possible. Let me know what you think and if there’s another useful python package you’d like me to check out.
https://youtu.be/EnC9ciDkXqA?si=T-Gm3KfFr-OIgCLN
/r/Python
https://redd.it/1gdwo2h
Django REST framework project for managing product of e-commerce application
I created this Django project for an e-commerce project's product management a few months ago with the Django REST framework.
If anyone wants to use it here is the link.
https://github.com/abdulawalarif/ecommerce\_backend\_DRF
/r/django
https://redd.it/1gdtv66
5 months ago i asked which course to start django with ,now what's my next step ?
Greetings,
Five months ago, I created a post asking about how to start with Django. Months later, I completed a few courses, including a four-month ALX backend Django-focused course, and I made few basic API projects and few simple CRUD functionality projects using function-based views (FBV) and class-based views (CBV). Here’s one of my projects: https://github.com/Gamaljim/Fitness\_dj\_api (excuse the lack of a README or .gitignore file; I'm still learning how to properly set up a repo).
I'm 30 years old, stuck in a dead-end job in a country I don't want to be in, and I'm doing my best to study after work to shift my career and get back home as soon as possible. After finishing the course, I asked my instructor for feedback, and he said there’s still a lot to learn and that I’m not ready to apply for jobs yet. I understand this, but it did bring me down, and while I wouldn't say I'm depressed, I definitely feel low.
Now, to get to my question: What should I learn next? I've heard about CI/CD, Docker, Redis, and Celery, but these are foreign terms to me, and I don't know where and what to start with.
I hope you understand
/r/django
https://redd.it/1gdr3co
Monday Daily Thread: Project ideas!
# Weekly Thread: Project Ideas 💡
Welcome to our weekly Project Ideas thread! Whether you're a newbie looking for a first project or an expert seeking a new challenge, this is the place for you.
## How it Works:
1. **Suggest a Project**: Comment your project idea—be it beginner-friendly or advanced.
2. **Build & Share**: If you complete a project, reply to the original comment, share your experience, and attach your source code.
3. **Explore**: Looking for ideas? Check out Al Sweigart's ["The Big Book of Small Python Projects"](https://www.amazon.com/Big-Book-Small-Python-Programming/dp/1718501242) for inspiration.
## Guidelines:
* Clearly state the difficulty level.
* Provide a brief description and, if possible, outline the tech stack.
* Feel free to link to tutorials or resources that might help.
# Example Submissions:
## Project Idea: Chatbot
**Difficulty**: Intermediate
**Tech Stack**: Python, NLP, Flask/FastAPI/Litestar
**Description**: Create a chatbot that can answer FAQs for a website.
**Resources**: [Building a Chatbot with Python](https://www.youtube.com/watch?v=a37BL0stIuM)
# Project Idea: Weather Dashboard
**Difficulty**: Beginner
**Tech Stack**: HTML, CSS, JavaScript, API
**Description**: Build a dashboard that displays real-time weather information using a weather API.
**Resources**: [Weather API Tutorial](https://www.youtube.com/watch?v=9P5MY_2i7K8)
## Project Idea: File Organizer
**Difficulty**: Beginner
**Tech Stack**: Python, File I/O
**Description**: Create a script that organizes files in a directory into sub-folders based on file type.
**Resources**: [Automate the Boring Stuff: Organizing Files](https://automatetheboringstuff.com/2e/chapter9/)
Let's help each other grow. Happy
/r/Python
https://redd.it/1gdoyr5
Can I use both CPU and GPU cores simultaeneously?
I am currently working on an economic model using anaconda and Im kinda new to this.
The simulation is kinda slower than macbook m1 chips where it would take thrice the amount of time to complete the simulation
I am wondering if I can use both gpu (rx6600) and cpu (r7 5700x) to have as much cores for computing power.
/r/Python
https://redd.it/1gddbc6
How can I incorporate data science in Django project?
Hello, I’m working on a data science project for academic research. I need to do some data analysis (I mean, data acquisition, pre-processing and data processing), specifically, it is about natural language processing so I also need to train a machine learning model I can get an output I can put in a map (a Google map).
I’ve selected Django as the back-end framework I will use together with Flutter to develop my user interface for a mobile app in which I can deploy my map.
So, my question is how can I handle my data analysis code into the Django project so I am able to map the output of my analysis into my geographic map, that is to say: where do I have to put my data analysis logic in the Django project considering I am planning to save the data I retrieve externally into a database based on my models? and, consequently how can I store the analysis into the database?
Somebody told me about using microservices but, is that really necessary? In which cases are they used? And, can I manage this locally or what approach should I use to manage this data processing? at what point would I
/r/django
https://redd.it/1gd0wms
Trying Django {% url %} tag but not working as expected
https://redd.it/1gdan1n
@pythondaily
D Last Week in Medical AI: Top LLM Research Papers/Models (October 19 - October 26)
Last Week in Medical AI: Top LLM Research Papers\/Models \(October 19 - October 26\)
Medical AI Paper of the Week:
Safety principles for medical summarization using generative AI by Google
This paper discusses the potential and challenges of applying large language models (LLMs) in healthcare, focusing on the promise of generative AI to support various workflows. Medical LLM & Other Models:
Medical LLM & Other Models:
BioMistral-NLU: Medical Vocab Understanding
This paper introduces BioMistral-NLU, a generalizable medical NLU model fine-tuned on the MNLU-Instruct dataset for improved performance on specialized medical tasks. BioMistral-NLU outperforms existing LLMs like ChatGPT and GPT-4 in zero-shot evaluations across six NLU tasks from BLUE and BLURB benchmarks.
Bilingual Multimodal LLM for Biomedical Tasks
This paper introduces MedRegA, a novel region-aware medical Multimodal Large Language Model (MLLM) trained on a large-scale dataset called MedRegInstruct.
Metabolic-Enhanced LLMs for Clinical Analysis
This paper introduces Metabolism Pathway-driven Prompting (MPP) to enhance anomaly detection in clinical time-series data by integrating domain knowledge of metabolic pathways into LLMs.
Dermatology Foundation Model
This paper introduces PanDerm, a multimodal dermatology foundation model trained on over
/r/MachineLearning
https://redd.it/1gd6k6j
Django and iOS/android apps?
Is it possible to create one Django web app and also release iOS and android versions of that app without having to write in the native languages? It would be great to avoid having to learn/write in 3 frameworks but also is great for consistency/maintainability, only having to maintain the code in one place
Of course, a Django web app can be used on mobile, but people always seem to say that users want to actually install an iOS/ android app instead. What is the best option here?
/r/django
https://redd.it/1gd77ho
How do I compare a form in CKEditorField and StringField?
I am using flask and flask-sqlalchemy and flask-wtf-forms.
Imagine I have 2 forms where one form is placed in each flask route.
Lets start with the first route and the first form.
The 1st form has the flask wtf field CKEditorField
. Within the route I type zzz
in the form. Next I save this in the Posts
table as the content
column. Now lets switch to the second route and second form.
In the 2nd route I am using StringField
. Then in a form, I input/type zzz
.
Now I am using a custom validator in the form and I query one_or_None
for the Posts
table. If Posts
returns something I then test if posts_db.content == content_form'
I raise the validationerror('the post is not unique")
. This should work but what if I use something like bold in the ckeditor
form. How would I get the output in the second Stringfield
form? The only solution I can think of is passing on the variable posts_db
in the route. Does anyone have any other suggestions?
TLDR:
I have 2 forms. The 1st form being CKEditorField
,in the 1st route, which I fill with the text 'zzz' then save it the Posts
db
/r/flask
https://redd.it/1gcujm2
D Self-Promotion Thread
Please post your personal projects, startups, product placements, collaboration needs, blogs etc.
Please mention the payment and pricing requirements for products and services.
Please do not post link shorteners, link aggregator websites , or auto-subscribe links.
--
Any abuse of trust will lead to bans.
Encourage others who create new posts for questions to post here instead!
Thread will stay alive until next one so keep posting after the date in the title.
--
Meta: This is an experiment. If the community doesnt like this, we will cancel it. This is to encourage those in the community to promote their work by not spamming the main threads.
/r/MachineLearning
https://redd.it/1gd0v8r
Configuration format
I currently use JSONs for storing my configurations and was instead recommended YAML by a colleague. I tried it out, and it looks decent. Big fan of the ability to write comments. I want to switch, but wanted to get opinions regarding pros and cons from the perspective of file size, time taken to read/write and how stable are the corresponding python libraries used to handle them.
My typical production JSONs are ~50 MB. During the research phase, they can be upto ~500 MB before pruning.
/r/Python
https://redd.it/1gcq5rg
Beginner in Web Dev – Need Advice on Architecting a Website for a RAG System Chatbot (Using Flask/Python)
I’m building a simple chatbot website to deploy a Retrieval-Augmented Generation (RAG) system I’ve developed, and I need some advice on the architecture. The generator itself runs through an API, and my goal is to keep the setup efficient and fast. I’m experienced in ML but new to web development, so I’d love some pointers on how to structure this in a way that’s simple and effective.
If anyone has experience building a website for a RAG system, I’d love to hear about your architecture—especially how you set up and deployed the API for handling requests. Did you use something specific to optimize for speed and resource management? Any tips for handling responses and managing requests would be super helpful, especially for Flask/Python setups. Thanks in advance!
/r/flask
https://redd.it/1gculgn
How to setup a permanent session in default Flask?
If I use Flask-Session to store session data server-side, it is as easy as passing SESSION_PERMANENT = False
(not default Flask, unique to Flask-Session) to the app.config, then set the desired expiration time with , PERMANENT_SESSION_LIFETIME = desired_exp_time
which is default Flask config.
If I use default Flask to store session data client-side, I need to set PERMANENT_SESSION_LIFETIME = desired_exp_time
first, then state session.permanent = True
in the request (ex. u/app.route), else I get this error: RuntimeError: Working outside of request context
. The docs is somewhat unclear about how to implement, see here.
What I don't understand is how to setup the default Flask one. I tried to google, and found this in Stack Overflow. The accepted answer suggests setting it with before\_request, but I think why every request, we need to set session.permanent = True
?
1. How to set permanent sessions in default flask properly? Where to set it?
2. Can you toggle permanent and non permanent session?
3. What should we do after session is expired? What about the session data?
/r/flask
https://redd.it/1gdur94
MFA for Django rest framework
Hi folks
I created TOTP to our dashboard so users can add MFA i have searched a lot for a package to do it but found nothing
So i have created this package from my code that works very well on production i found other packages but for Django not for rest framework this package is very simple and easy to use
It's my first time to release a Diango package so i wish it can help you and if you found it helpful please give it a star
https://github.com/mohamed-alired/drf-totp
/r/djangolearning
https://redd.it/1gcpbei
🔮Blackjack Strategy Simulator: The Most Comprehensive Open-Source Tool for Blackjack Analysis! 🔮
The **Blackjack Strategy Simulator** is a powerful tool for simulating every possible blackjack scenario to help users find the best move in any situation.
## What My Project Does
It allows you to:
* **Generate custom basic strategy tables** for various rule sets, including card splits and surrender options.
* **Simulate and analyze expected value (EV)** to understand the profitability of different strategies.
* **Calculate the best possible action** for any hand, considering complex rules and deck compositions.
* **Create advanced strategies** that adapt based on card counting or pre-set strategies.
## Comparison to Existing Alternatives
The **Blackjack Strategy Simulator** stands out in a few key areas:
* **Customization:** Unlike many online blackjack calculators, this simulator allows users to configure various game rules, including the number of decks, dealer behavior on soft 17, and advanced options like card counting deviations.
* **Detailed Analysis:** The tool provides a more thorough analysis than most basic calculators, considering complex scenarios such as multiple splits and custom deck compositions.
* **Open-Source Flexibility:** As an open-source project, it is highly customizable, with support for additional strategies and rule sets. Existing alternatives often lack this level of flexibility and transparency.
This tool offers a detailed approach to blackjack analysis by simulating millions of hands with high accuracy and
/r/Python
https://redd.it/1gdg3e9
Developing a Python-based Graphics Engine: Nirvana-3D
Hello community members,
[Crossposted from: https://www.reddit.com/r/gamedev/comments/1gdbazh/developing\_a\_pythonbased\_graphics\_engine\_nirvana3d/ \]
I'm currently working in GameDev and am currently reading and working on a 3D Graphics/Game Engine called: Nirvana 3D, a game engine totally written from top to bottom on Python that relies on NumPy
Library for matrices and Matplotlib
for rendering 3D scenes and imageio
library for opening image files in the (R, G, B)
format of matrices.
Nirvana is currently at a very nascent and experimental stage that supports importing *.obj
files, basic lighting via sunlights, calculation of normals to the surface, z-buffer, and rendering 3D scenes. It additionally supports basic 3D transformations - such as rotation, scaling, translations, etc, with the support of multiple cameras and scenes in either of these three modes - wireframes
, solid
(lambert), lambertian
shaders, etc.
While it has some basic support handling different 3D stuff, the Python code has started showing its limitations regarding speed - the rendering of a single frame takes up to 1-2 minutes on the CPU. While Python is a very basic, simple language, I wonder I'd have to port a large part of my code to GPUs or some Graphics Hardware languages like GLES/OpenCL/OpenGL/Vulcan or something.
I've planned the support for PBR shaders (Cook-Torrance Equation, with GGX approximations of Distribution and Geometry Functions) in solid mode as well as PBR shaders with HDRi lighting for texture-based image rendering and getting a
/r/Python
https://redd.it/1gdbl5l
SmartProfiler: The All-in-One Solution for Python Performance Insights
# What My Project Does
SmartProfiler is a lightweight Python library that simplifies profiling your code by providing insights into execution time, memory usage, CPU time, and function call counts. Whether you’re optimizing performance, debugging, or monitoring function calls in multithreaded applications, SmartProfiler has you covered with minimal setup and overhead.
# Target Audience
SmartProfiler is perfect for:
Data Scientists who need to optimize data processing tasks.
Developers looking to enhance the performance of their applications.
Researchers who require detailed profiling for simulations or computations.
Anyone working with Python who wants to gain insights into their code's performance.
# Comparison
While many profiling tools focus on specific metrics, such as memory or execution time, SmartProfiler uniquely combines:
Unified Profiling: All-in-one solution for profiling time, memory, CPU, and function calls.
Thread-Safe: Specifically designed for multithreaded environments, avoiding race conditions.
Minimal Overhead: Provides accurate profiling with little impact on application performance.
# Key Features
Function-Level Profiling: Easily profile functions with decorators.
Code Block and Line Profiling: Profile specific blocks or lines using context managers.
Multithreaded Profiling: Supports profiling in concurrent applications.
Flexible Logging: Integrates with Python's logging framework for detailed insights.
Function Call Tracking: Count function calls efficiently in a thread-safe manner.
# Example Usage
# Time Profiling for Functions
/r/Python
https://redd.it/1gdjz16
Tailwind styles aren’t working with forms
Trying to get my tailwind styles to work with my login form.
I am using django-tailwind. But some reason styles aren’t taking. I’ve restarted with tailwind server and Django server no change.
```
from django.contrib.auth.models import User # Ensure you import the correct User model
from django import forms
class LoginForm(forms.ModelForm):
class Meta:
model = User
fields = ['username', 'password']
username = forms.CharField(
label='Username',
widget=forms.TextInput(attrs={
'class': 'bg-gray-50 border border-gray-300 text-gray-900 rounded-lg focus:ring-primary-600 '
'focus:border-primary-600 block p-2.5 dark:bg-gray-700 dark:border-gray-600 '
'dark:placeholder-gray-400 dark:text-white dark:focus:ring-blue-500 dark:focus:border-blue-500',
'placeholder': 'Username'
}),
required=True
)
/r/djangolearning
https://redd.it/1gdnfko
Discord recommendations for Flask Devs?
What are the best Discords for Flask developers? Some general python discords are welcomed as well.
/r/flask
https://redd.it/1gdg84b
profile pic not showing
models.py:
class Profile(models.Model):
user = models.OneToOneField(User,ondelete=models.CASCADE)
userimage = models.ImageField(uploadto="userpic/")
def str(self):
return self.user.username
urls.py:
from django.conf import settings
from django.conf.urls.static import static
urlpatterns += +static(settings.MEDIAURL, documentroot=settings.MEDIAROOT)
html template:
<img src="{{ user.profile.userimage.url }}" alt="img">
error showing in terminal:
Not Found: /picture/userpic/10987982.jpg
GET /picture/userpic/10987982.jpg HTTP/1.1" 404 2270
the image stored in picture/user_pic/ but not rendered on html template but user name and first name is render in html template
/r/django
https://redd.it/1gdbbd8
We're thinking of rewriting our go / java API in python, what do we need to think about?
Background:
We have a horrible hodgepodge of APIs in front of our data platform, java that mostly calls underlying functions in the go (with slightly more user friendly calls). The go API often calls bash scripts to do the actual work. Most of the stuff the API does is building a call for an external service like doing spark submit on the file the user has provided or creating a table in hive with details the user has provided. The java API has swagger and is mostly what all users call.
One option we have is to rewrite it all in go getting rid of java and bash, write swagger into the go and all the things the java does.
But we're predominantly a python shop, which means whenever something needs to be done with the APIs only a few people are prepared to go near it and it's recieved very little change over the years where the rest of the platform is moving on rapidly.
So a few of us are in favour for rewiteing it all in something like fastAPI, (or maybe black sheep?)
From what I understand this would basically give us swagger for free and mean there
/r/Python
https://redd.it/1gdavp9
Looking for someone willing to join a call with me to review my code
I'm working on Django Rest Framework and built REST API with MySQL workbench as database, I've got most of the code done, but I'm facing bugs in authentication that I've been stuck on for a really long time and I can't move on with my project without fixing them, I really tried everything and I'm trying this as a last option, I don't want anyone to write me code, I'm suggesting if someone is willing to join a discord call with me where I can share my screen and they can review my code and maybe tell me what I've been doing wrong. it's not a large project and I'll make sure I don't take much time, it'll be much appreciated, thanks for everyone in advance :)
/r/django
https://redd.it/1gd7jpy
How did you first learn about Python?
How did all of you stumble upon python? I saw someone writing python in RuneScape one day and became curious. Then I dipped into front end frameworks like html and css, then JavaScript and python
/r/Python
https://redd.it/1gcwcex
Moving to Canada Soon! Looking to Connect with Fellow Django Devs
Hey everyone! I'm moving to Canada in about four months, and I'm excited to connect with people working with Django. I have around three years of experience building large-scale Django apps that handle millions of data entries, and I'm always looking to improve and learn from others.
If you're in Canada or familiar with the Django scene there, I'd love to hear any insights, or tips, or just chat about the latest in Django development! 😊
/r/django
https://redd.it/1gcx9ax
Sunday Daily Thread: What's everyone working on this week?
# Weekly Thread: What's Everyone Working On This Week? 🛠️
Hello /r/Python! It's time to share what you've been working on! Whether it's a work-in-progress, a completed masterpiece, or just a rough idea, let us know what you're up to!
## How it Works:
1. Show & Tell: Share your current projects, completed works, or future ideas.
2. Discuss: Get feedback, find collaborators, or just chat about your project.
3. Inspire: Your project might inspire someone else, just as you might get inspired here.
## Guidelines:
Feel free to include as many details as you'd like. Code snippets, screenshots, and links are all welcome.
Whether it's your job, your hobby, or your passion project, all Python-related work is welcome here.
## Example Shares:
1. Machine Learning Model: Working on a ML model to predict stock prices. Just cracked a 90% accuracy rate!
2. Web Scraping: Built a script to scrape and analyze news articles. It's helped me understand media bias better.
3. Automation: Automated my home lighting with Python and Raspberry Pi. My life has never been easier!
Let's build and grow together! Share your journey and learn from others. Happy coding! 🌟
/r/Python
https://redd.it/1gcygl6
D Train on full dataset after cross-validation? Semantic segmentation
I am currently working on a semantic segmentation project of oat leaf disease symptoms. The dataset is quite small, 16 images. Due to time constraints, I won't be able to extend this.
I am currently training 3 models, 3 backbones, and 3 losses--using 5-fold cross validation and grid search.
Once this is done, I plan to then run cross validation on a few different levels of augmentations per image.
My question is this:
Once I have established the best model, backbone, loss, and augmentation combination, can I train on the full dataset since it is so small? If I can do this, how do I know when to stop training to prevent overfitting but still adequately learn the data?
I have attached an image of some results so far.
https://preview.redd.it/sx394c58l5xd1.png?width=2000&format=png&auto=webp&s=3cefbf5c84bf3fbf48936c47810c4e3039dcb410
Thanks for any help you can provide!
/r/MachineLearning
https://redd.it/1gct22r