1102
Daily Python News Question, Tips and Tricks, Best Practices on Python Programming Language Find more reddit channels over at @r_channels
Python Model for PDF table extraction
Hi
I am looking for a python library model that can extract tables out of PDF, but here are some more requirements:
a) Able to differentiate two table in same page, having different width
b) Able to Understand table that spans across multiple Pages in Same pdf
Tried Tabula, pyMuPDF both are not showing any good results, Suggest some better models
/r/Python
https://redd.it/1hqbfm5
Trending Django Projects in 2024
https://django.wtf/trending/?trending=365
/r/django
https://redd.it/1hqfkrx
I've made a video showcase of my Python & Pygame 2024 projects
I just finished a video where I showcase the projects I’ve worked on this year using Python and Pygame. I'd love to share it with you🙂
What My Project Does
The video highlights a variety of projects, including a Voronoi diagram, maze generation, inverse kinematics, a face-swapping app, a physics-based puzzle game, fractals, and more. These projects showcase a use of Python and Pygame to create different kinds of graphical applications.
Target Audience
The projects are primarily learning experiments and hobbyist creations meant to inspire and others in the Python community.
Comparison
These projects explore creative and technical concepts within the Python and Pygame. While they don’t aim to replace tools or libraries, they focus on showcasing how even lightweight frameworks like Pygame can handle topics like physics and visual effects.
Here’s the link to the video: https://youtu.be/osIiUCe\_47s
The source code for most projects is available on my GitHub. If you can’t find something, feel free to ask!
https://github.com/robomarchello
Wishing you all a Happy New Year 🎉
/r/Python
https://redd.it/1hqc5rx
Python "guiding principles"
Longtime C, C++ and Java developer and teacher here. I came across the 1999 "Python Guiding Principles" and found a number of them to be, at best, opaque. Examples:
Beautiful is better than ugly
Now is better than never
Just from reading Python syntax, what I've been able to gather is that the language does not, among other things, force developers to type more characters than should be absolutely necessary to convey a programming concept. So no semicolons to terminate statements, no curly braces to delineate code blocks, etc.
Perhaps I'm missing what Tim Peters intended when he wrote the Guiding Principles. I thought they would be statements that are unique to Python, as compared with other languages. What they appear to be (and seen from this perspective I agree with most of them) are good guiding principles for software development in any language.
Would anyone like to weigh in on what they feel are the basic characteristics of Python that set it apart from other programming languages?
/r/Python
https://redd.it/1hpz4vp
Tuesday Daily Thread: Advanced questions
# Weekly Wednesday Thread: Advanced Questions 🐍
Dive deep into Python with our Advanced Questions thread! This space is reserved for questions about more advanced Python topics, frameworks, and best practices.
## How it Works:
1. **Ask Away**: Post your advanced Python questions here.
2. **Expert Insights**: Get answers from experienced developers.
3. **Resource Pool**: Share or discover tutorials, articles, and tips.
## Guidelines:
* This thread is for **advanced questions only**. Beginner questions are welcome in our [Daily Beginner Thread](#daily-beginner-thread-link) every Thursday.
* Questions that are not advanced may be removed and redirected to the appropriate thread.
## Recommended Resources:
* If you don't receive a response, consider exploring r/LearnPython or join the [Python Discord Server](https://discord.gg/python) for quicker assistance.
## Example Questions:
1. **How can you implement a custom memory allocator in Python?**
2. **What are the best practices for optimizing Cython code for heavy numerical computations?**
3. **How do you set up a multi-threaded architecture using Python's Global Interpreter Lock (GIL)?**
4. **Can you explain the intricacies of metaclasses and how they influence object-oriented design in Python?**
5. **How would you go about implementing a distributed task queue using Celery and RabbitMQ?**
6. **What are some advanced use-cases for Python's decorators?**
7. **How can you achieve real-time data streaming in Python with WebSockets?**
8. **What are the
/r/Python
https://redd.it/1hq1fjw
Planning flask project
I'm mostly self taught and am coming more from ds than webdev. The only webdev / html / css / js experience I have is from following Miguel's tutorial for a small blog.
I am building a website that hosts some of my ML models and takes in realtime data, then performs inference. The data pipeline is done, it uses a pub sub model and pushes the data to Redis.
I'm wondering:
- Is flask suitable for this as it doesn't support async intrinsically. The data pipeline is async and handles the data no issue, I tested it to 100's of GB a day. I would hate to have to rewrite. Is it as simple as switching to quart if need be?
- I would like nice realtime graphs to display everything. How would I let the website know that a new data point has been pushed? Somehow I need Redis to talk to flask.
- How would I make some kind of graph to display financial data. Can bootstrap do this or do I need some js library.
- I'm writing it using blueprints. Are there any repositories / sites that have already made blueprints. Seems like a waste
/r/flask
https://redd.it/1hq3zep
Making a custom model function as a login user?
Hey there, I've ran into an issue where I've been trying to create a custom model which has some basic data and then log-in functionality? I'm able to log in as a superuser but not using the data in my custom model. (Migrations have been made) What am I doing wrong here? This is the custom model which I'm currently using.
class Resident(AbstractUser):
"""
Custom User model representing HOA residents.
"""
verbosename = 'Resident'
firstname = models.CharField(maxlength=50)
lastname = models.CharField(maxlength=50)
address = models.CharField(maxlength=255, blank=True)
phonenumber = models.CharField(maxlength=25)
def str(self):
return
f"{self.firstname} {self.lastname}"
groups = models.ManyToManyField(
'auth.Group',
relatedname='residentgroups',
/r/djangolearning
https://redd.it/1hpooej
New to freelancing
Hello!
For those of you who started freelancing recently and made it work, how do you promote yourself and/or your business? What channels do you use to find quality customers?
I’ve beer working with Python for more than 8 years now and I’d want to build a business around it.
Thank you in advance!
/r/Python
https://redd.it/1hpo5zz
Is there a way to use split screen in Visual Studio Code to see HTML template changes in real time?
Or is there another IDE that can be used to visualize frontend changes?
/r/flask
https://redd.it/1hpjfua
Monday Daily Thread: Project ideas!
# Weekly Thread: Project Ideas 💡
Welcome to our weekly Project Ideas thread! Whether you're a newbie looking for a first project or an expert seeking a new challenge, this is the place for you.
## How it Works:
1. **Suggest a Project**: Comment your project idea—be it beginner-friendly or advanced.
2. **Build & Share**: If you complete a project, reply to the original comment, share your experience, and attach your source code.
3. **Explore**: Looking for ideas? Check out Al Sweigart's ["The Big Book of Small Python Projects"](https://www.amazon.com/Big-Book-Small-Python-Programming/dp/1718501242) for inspiration.
## Guidelines:
* Clearly state the difficulty level.
* Provide a brief description and, if possible, outline the tech stack.
* Feel free to link to tutorials or resources that might help.
# Example Submissions:
## Project Idea: Chatbot
**Difficulty**: Intermediate
**Tech Stack**: Python, NLP, Flask/FastAPI/Litestar
**Description**: Create a chatbot that can answer FAQs for a website.
**Resources**: [Building a Chatbot with Python](https://www.youtube.com/watch?v=a37BL0stIuM)
# Project Idea: Weather Dashboard
**Difficulty**: Beginner
**Tech Stack**: HTML, CSS, JavaScript, API
**Description**: Build a dashboard that displays real-time weather information using a weather API.
**Resources**: [Weather API Tutorial](https://www.youtube.com/watch?v=9P5MY_2i7K8)
## Project Idea: File Organizer
**Difficulty**: Beginner
**Tech Stack**: Python, File I/O
**Description**: Create a script that organizes files in a directory into sub-folders based on file type.
**Resources**: [Automate the Boring Stuff: Organizing Files](https://automatetheboringstuff.com/2e/chapter9/)
Let's help each other grow. Happy
/r/Python
https://redd.it/1hp9p8c
Django courses focusing beyond the basics
Most online courses focus on zero-to-one content (introducing the basics of a language or framework). I'm planning on creating micro-courses that go beyond stage one.
These micro-courses,
focus on one outcome
have a series of tasks/objectives to complete (learning by doing)
can be completed within a week by spending a few hours a day and
cover intermediate or advanced concepts
Examples,
1. Implementing webhooks for payment gateways
2. Processing webhook payloads the right way
3. Deploying a Django application on a VPS
4. Developing CLI tools for application housekeeping
5. Monitoring 500 errors in LIVE/PROD servers
6. Designing a backup policy and automating backups
Would you be interested in such micro-courses?
Any topic that you wish to add to this list?
/r/django
https://redd.it/1hpgv15
What’s your library “stack”?
Hello! I’m switching to Django for my personal projects haven’t spent a lot of energy using Go, which I love but I have had to reimplement a lot from scratch.
I’m curious to know what are your go-to libraries for the most common needs (but feel free to drop any amazing library worth mentioning) so that I can migrate what I usually do in go to Django.
I’ll mention what I’m thinking of using so far:
- Django rest framework to implement rest api (I’ll focus on react + drf for my projects)
- djoser for authentication (I’d need jwt and social)
- celery for async events and crons
- throttling, I think drf offers a solution using django-redis
- Django-impersonate to impersonate users for troubleshooting purposes
- uploading files to s3 instead of local storage
- channels for webhooks and web sockets
- permissions/groups/roles to allow disallow users from accessing other users’ resources (images and documents included).
/r/django
https://redd.it/1houdby
Simplify Jupyter Notebook Sharing with This IPYNB to PDF Tool
Hi Pythonistas! 👋
Ever needed to share your Jupyter Notebook as a professional-looking PDF but got stuck fiddling with nbconvert or other complex tools? I’ve found a super simple solution: rare2pdf.com/ipynb-to-pdf/.
✅ Just upload your .ipynb files. and it converts to a neat PDF in seconds. Perfect for presentations, sharing with non-tech folks, or archiving your work.
I’d love to hear if this saves you some time! Give it a try and let me know what you think. 😊
/r/IPython
https://redd.it/1hp33i0
Robyn(Web Framework) is deprecating views
Hey Everyone 👋
Robyn is deprecating views soon, and I wanted to share it with the community who is not present in our discord.
For the unaware - (probably this post is not super relevant) - Robyn is a Super Fast Async Python Web Framework with a Rust runtime.
To stay up to date with the PR - you can have a look here - https://github.com/sparckles/Robyn/pull/1096
/r/Python
https://redd.it/1hok999
ERROR ImproperlyConfigured: Error loading psycopg2 or psycopg module
I'm currently trying to update a Django rest api on AWS Lambda using the following command.
zappa update dev
However it gives me the following error
Error: Warning! Status check on the deployed lambda failed. A GET request to '/' yielded a 502 response code.
When I run the following
zappa tail
I see the error
ImproperlyConfigured: Error loading psycopg2 or psycopg module
Does anyone know how to fix this error? I check requirements.txt file and it has the latest version of both psycopg2 and psycopg2-binary (2.9.10). I don't know why I'm getting the error.
/r/flask
https://redd.it/1honehi
Supporting Nested Functions in Python Bytecode
Hi everyone! I’ve been building a Python interpreter in Rust, and my latest post dives into how I added support for nested functions in bytecode. If you’re curious about Python internals, interpreters, or how to unintentionally learn two languages deeply at the same time, check it out here: https://blog.fromscratchcode.com/how-i-added-support-for-nested-functions-in-python-bytecode. I’d love to hear your thoughts or answer any questions!
/r/Python
https://redd.it/1hqkqxn
Requirements.txt Auto-sorting VSCode Extension
Hi everyone,
I’ve recently developed a simple Visual Studio Code extension that automatically sorts the requirements.txt file alphabetically whenever you save. In larger projects, I often find myself searching to locate specific packages and their versions, so I thought this tool might help streamline that process.
What My Project Does: This extension alphabetically sorts the requirements.txt file while preserving comment requirement pairs. For example if a comment precedes a requirement, after alphabetically sorting the file, the comment requirement pair will stay grouped together. Essentially, this extension removes the need to use the command prompt's "Sort Lines Ascending" or "Descending" and will automatically alphabetize the file on save using the keyboard shortcut (cmd + s / control + s).
Target Audience: The project is intended for developers who are typically working in larger projects where there may be a long list of required packages. Additionally, developers who leave comments on their requirements.txt file to help track or manage version dependencies across multiple packages may find this useful.
Comparison: Unlike the built in Sort Lines Ascending and Descending, which also alphabetically sort the comments, this project leaves them intact and removes the need to navigate to the command prompt to sort the file. The sorting takes place on
/r/Python
https://redd.it/1hqdcza
Need help in email field. getting error
https://preview.redd.it/dx1zul2e46ae1.png?width=1880&format=png&auto=webp&s=2ea31662fca8ed6f5fd07bd10391bbbf942420d9
from flaskwtf import FlaskForm
from wtforms import StringField, PasswordField, SubmitField, BooleanField
from wtforms.validators import DataRequired, Length, Email, EqualTo
class RegistrationForm(FlaskForm):
username = StringField('Username',
validators=[DataRequired(), Length(min=2, max=20)])
email = StringField('Email',
validators=[DataRequired(), Email()])
password = PasswordField('Password', validators=[DataRequired()])
confirmpassword = PasswordField('Confirm Password',
validators=DataRequired(), EqualTo('password'))
submit = SubmitField('Sign Up')
class LoginForm(FlaskForm):
email = StringField('Email',
validators=DataRequired(), Email())
password = PasswordField('Password', validators=DataRequired())
remember = BooleanField('Remember Me')
submit = SubmitField('Login')
/r/flask
https://redd.it/1hqcptx
I made a CLI that generates terminal UIs from simple text prompts
Demo + more details here: https://github.com/shobrook/termite
What my project does:
Describe a terminal UI (TUI) in natural language (e.g., "Make me a dashboard for managing my Docker containers"), and an LLM will design and implement it within 1-2 minutes.
Target Audience:
Anyone building a TUI would benefit from this since it helps you quickly bootstrap or prototype one. But it's also useful as a general-purpose terminal assistant since a lot of tasks are best solved with an interface (e.g., "Show me which ports are currently active").
Comparison:
As far as I know, this is the first project to implement generative UI in the terminal. The concept of generating UI from text prompts has been around for the last year and is popular in the web development space (see v0.dev) but nonexistent in the world of terminals.
/r/Python
https://redd.it/1hpuh0o
How to structure project from beginning?
Have kind of a random question about django project structure and apps.
Let’s say you have an idea you want to test and get an MVP up pretty quickly. The end idea is complex and has many models and functionality.
Is it a good idea to separate functionally based on models into apps when you start or refactor later?
Let’s say as an example I have users, comments, projects, messages, and more.
Thanks!
/r/djangolearning
https://redd.it/1hp7sbq
(when) do i need to make things async
currently writing a mini reddit clone with flask and sqlite for the backend. i'm concerned that once things scale that i'll need better async support that flask cannot provide. how often is this a legitimate concern? i understand there are alternatives like quart but i want to know if it's flask that will likely limit me, if i need to be thinking about async functions at all, and if so what scenarios those would be.
/r/flask
https://redd.it/1hpz4ob
Flask project front end design and modification for non-technical web site owners
I'm creating a website for a company that want their clients to be able to login to a portal and submit jobs for the company to complete. All of this will be handled with Flask and the aesthetic and design of these portal pages is not that significant.
For the front end, the design is much more important and I don't want to have to design and hand craft every page. I really want to be able to separate myself as the developer as much as possible from the designer or content producers for the site. What options are there for incorporating something that will easily let the company design and update the front end pages themselves (or employ a designer to do so)?
There will only be a handful of pages (home page, about us, contact us, Ts & Cs kind of thing) so using a headless CMS would just be a monthly expense for something that isn't going to change or be used that much, but is something I still want to separate myself as the developer from. It would also mean that I can just crack on with solving the technical aspects of letting clients submit jobs rather than
/r/flask
https://redd.it/1hpy3xs
This year, I’ve learned Django for 306 days...
/r/django
https://redd.it/1hpktzg
Django courses focusing beyond the basics
Most online courses focus on zero-to-one content (introducing the basics of a language or framework). I'm planning on creating micro-courses that go beyond stage one.
These micro-courses,
focus on one outcome
have a series of tasks/objectives to complete (learning by doing)
can be completed within a week by spending a few hours a day and
cover intermediate or advanced concepts
Examples,
1. Implementing webhooks for payment gateways
2. Processing webhook payloads the right way
3. Deploying a Django application on a VPS
4. Developing CLI tools for application housekeeping
5. Monitoring 500 errors in LIVE/PROD servers
6. Designing a backup policy and automating backups
Would you be interested in such micro-courses?
Any topic that you wish to add to this list?
/r/djangolearning
https://redd.it/1hpgxfs
Looking for remote job as Backend Engineer
Hi,
I have more than 3 years of experience with Python, Django, DRF, Rest APIs, Postgresql, Postgis, GIS, QGIS Plugin Development, LLMs, Generative AI, Git Versioning, and AWS(EC2, S3, Lambda, RDS).
I do have references from my previous clients.
Can you please guide me on how to land a remote job?
Thanks
/r/django
https://redd.it/1hpirb7
How do you manage sending mails with SMTP with all analytics and tracking on SES?
I am looking to have a custom implementation for sending and tracking mails. SES can do tracking, but I want to have a robust mail sending system. I have tried listmonk and it does not track for campaigns and the customizability is limited there. I'm looking to build a custom sender.
Is there anything I should avoid while building this? Is send and forget the right way and forcing SES to manage delivery +other analytics the best way?
Does anyone have some repos with a really good implementation of a mail sending system?
/r/django
https://redd.it/1hoz76e
I made an AI-powered IPython REPL
Hey everyone, I made an AI-powered IPython REPL that lets you understand, debug, and write better code faster. It uses relevant context from your session to suggest the best responses to your questions. You can choose between gpt-4o and claude-3.5-sonnet, I'm planning to add local models soon. You can check out the code on GitHub and install it from PyPI using pip install ipychat.
Here's a demo:
https://i.redd.it/7ex5dpezdu9e1.gif
/r/IPython
https://redd.it/1hp42eq
Automated Dataset Generation for Object Detection
# What My Project Does
This project shows how we can generate custom synthetic datasets for training object detection models. Think of it like making your own training data on demand, especially when getting real-world images is a headache.
# Target audience
This project is designed for individuals who want to learn how to create their own datasets for computer vision tasks but are tired of the usual data struggles. It’ll walk you through the whole process, from coming up with ideas for your data to automatically labeling it, so you can skip the endless manual work.
# Comparison
Right now, if you need data to train a custom object detector, you're usually stuck either spending forever labeling stuff yourself or dealing with the hassle of finding and paying for existing datasets. And even then, it might not be exactly what you need. But now, with all these AI vision models and image generators popping up, there's a new way to do things. Instead of the usual manual grind, we can use LLMs and vision models to create the training data we actually need. Since there are tons of these models out there, both free and paid, you've got a lot of choices to find
/r/Python
https://redd.it/1hop3tn
[D] Structure of Neural Embeddings
https://seanpedersen.github.io/posts/structure-of-neural-latent-space
/r/MachineLearning
https://redd.it/1hogog5
Not able to login in a user to my VueJS frontend which communicates with my Django backend
This is for those that are also familiar with VueJS and DRF. But I am trying to login as a user, with an email/password I just created on the Login Page. But when I click the 'Login' button nothing happens, it should log me in and redirect me to the 'Homeowner Dashboard' page. To clarify I got DRF set with up Django, that is I created the API calls that connect to my Django API views.
So I'm not exactly sure why this is happening, I don't know if this is strictly a VueJS, Django or DRF issue or all of them. Also when I inspect the page in the console, it just says 'API call successful:'. I have axios implemented in my VueJS project.
I'd share my code here, however I wouldn't even know where to begin. I'm simply testing my project from the frontend to the backend. I'm not sure if creating a user in Django Admin would help or not. Pretty sure this is easy fix somewhere. Please help me with this, my project repos are set to private but I can make them both public for you guys to see if that would
/r/django
https://redd.it/1hopbtj
