17814
Admin: @Raminmousa Watsapp: +989333900804 ID: @Machine_learn link: https://t.me/Machine_learn
با عرض سلام نفر سوم از مقاله مروری بالا رو نیاز داریم. با قبولی شرایط کسی نیاز داشت به بنده اطلاع بده.
نشریه مد نظر : Nature
@Raminmousa
Primers • Overview of Large Language Models
📖 Link
@Machine_learn
با عرض سلام نفر سوم براي مقاله زير رو خالي داريم.
Title: Alzheimer’s disease (AD) classification
using swin transformer wavelet
and Improved Gray Wolf
Optimization (IGWO)
Abstract: Alzheimer’s disease (AD) is a slow neurological disorder that destroys the thought process, and consciousness, of a human. It directly affects the development of mental ability and neurocognitive functionality. The number of patients with Alzheimer’s disease is increasing day by day, especially in old aged people, who are above 60 years of age, and, gradually, it becomes cause of their death. In this research, our goal is to present ALzSwinTNet for Alzheimer’s classification based on FMRI images. The proposed approach uses wavelet fusion in the swin transformer network to extract features. The igwo and fox optimization approaches were used to find the hyperparameters of the model. ALzSwinTNet was able to achieve an accuracy of 0.98 in 4-class classification and 1 in 2-class classification.
journal: https://www.sciencedirect.com/journal/expert-systems-with-applications
if:7.5
هزینه مشارکت برای نفر سوم ۲۰ تومن می باشد. این هزینه صرف تسویه سرورها خواهد شد.
@Raminmousa
@Machine_learn
/channel/+SP9l58Ta_zZmYmY0
📃Graph Neural Networks: A Bibliometric Mapping of the Research Landscape and Applications
📎 Study paper
@Machine_learn
Data Structures and Information Retrieval in Python
📓 link
@Machine_learn
با عرض سلام نفر سوم براي مقاله زير رو خالي داريم.
Title: Alzheimer’s disease (AD) classification
using swin transformer wavelet
and Improved Gray Wolf
Optimization (IGWO)
Abstract: Alzheimer’s disease (AD) is a slow neurological disorder that destroys the thought process, and consciousness, of a human. It directly affects the development of mental ability and neurocognitive functionality. The number of patients with Alzheimer’s disease is increasing day by day, especially in old aged people, who are above 60 years of age, and, gradually, it becomes cause of their death. In this research, our goal is to present ALzSwinTNet for Alzheimer’s classification based on FMRI images. The proposed approach uses wavelet fusion in the swin transformer network to extract features. The igwo and fox optimization approaches were used to find the hyperparameters of the model. ALzSwinTNet was able to achieve an accuracy of 0.98 in 4-class classification and 1 in 2-class classification.
journal: https://www.sciencedirect.com/journal/expert-systems-with-applications
if:7.5
هزینه مشارکت برای نفر سوم ۲۰ تومن می باشد. این هزینه صرف تسویه سرورها خواهد شد.
@Raminmousa
@Machine_learn
/channel/+SP9l58Ta_zZmYmY0
OrientedFormer: An End-to-End Transformer-Based Oriented Object Detector in Remote Sensing Images
Publication date: IEEE Transactions on Geoscience and Remote Sensing 2024
Topic: Object detection
Paper: https://arxiv.org/pdf/2409.19648v1.pdf
GitHub: https://github.com/wokaikaixinxin/OrientedFormer
Description:
In this paper, we propose an end-to-end transformer-based oriented object detector, consisting of three dedicated modules to address these issues. First, Gaussian positional encoding is proposed to encode the angle, position, and size of oriented boxes using Gaussian distributions. Second, Wasserstein self-attention is proposed to introduce geometric relations and facilitate interaction between content and positional queries by utilizing Gaussian Wasserstein distance scores. Third, oriented cross-attention is proposed to align values and positional queries by rotating sampling points around the positional query according to their angles.
@Machine_learn
Computational Geometry
📕 Book
@Machine_learn
Welcome to Ollama's Prompt Engineering Interactive Tutorial
🔗 Github
/channel/deep_learning_proj
یک هفته تا سابمیت نهایی این مقاله باقی مونده...!
Читать полностью…
⭐️ Region-Aware Text-to-Image Generation via Hard Binding and Soft Refinement
RAG-Diffusion now supports FLUX.1 Redux!
🔥 Ready to take control? Customize your region-based images with our training-free solution and achieve powerful, precise results!
🔗 Code: https://github.com/NJU-PCALab/RAG-Diffusion
@Machine_learn
LLM-based agents for Software Engineering
"Large Language Model-Based Agents for Software Engineering: A Survey".
https://github.com/FudanSELab/Agent4SE-Paper-List.
/channel/deep_learning_proj
با عرض سلام نفر سوم و چهارم براي مقاله زير رو خالي داريم.
Title: Alzheimer’s disease (AD) classification
using swin transformer wavelet
and Improved Gray Wolf
Optimization (IGWO)
Abstract: Alzheimer’s disease (AD) is a slow neurological disorder that destroys the thought process, and consciousness, of a human. It directly affects the development of mental ability and neurocognitive functionality. The number of patients with Alzheimer’s disease is increasing day by day, especially in old aged people, who are above 60 years of age, and, gradually, it becomes cause of their death. In this research, our goal is to present ALzSwinTNet for Alzheimer’s classification based on FMRI images. The proposed approach uses wavelet fusion in the swin transformer network to extract features. The igwo and fox optimization approaches were used to find the hyperparameters of the model. ALzSwinTNet was able to achieve an accuracy of 0.98 in 4-class classification and 1 in 2-class classification.
journal: https://www.sciencedirect.com/journal/expert-systems-with-applications
if:7.5
هزینه نفرات به ترتیب ۲۰ و ۱۵ تومن می باشد. این هزینه صرف تسویه سرورها خواهد شد.
@Raminmousa
@Machine_learn
/channel/+SP9l58Ta_zZmYmY0
📚 Machine learning mastery
🔗 Github
@Machine_learn
📃Deep learning approaches for non-coding genetic variant effect prediction: current progress and future prospects
📎 Study the paper
@Machine_learn
با عرض سلام در راستاي ادامه تحقيقات مشترك سعي داريم از ١ ام دي ماه روي حوزه ي LLM مدل ها كار كنيم. حدودا ٤ نفر براي كار زير نياز داريم.
BioPars: a pre-trained biomedical large language model for persian biomedical text mining.
١- مراحل اوليه: جمع اوري متن هاي فارسي بيولوژيكي از منابع (...)
٢- پيش پردازش متن ها و تميز كردن متن ها
٣- اموزش ترنسفورمرها ي مورد نظر
٤- استفاده از بردارها ي اموزش داده شده در سه تسك (...)
دوستاني كه مايل به مشاركت هستن مي تونين تا ١ دي بهم اطلاع بدن.
هزينه سرور به ازاي هر ساعت ١.٢ دلار مي باشد. و حدود ٢ هزار ساعت براي اموزش مدل زباني نياز ميباشد. هزينه به ترتيب براي نفرات علاوه بر انجام تسك ها به صورت زير مي باشد.
🔺نفر سوم ٣٠ ميليون
🔹نفر چهارم ٢٥ ميليون
🔺نفر پنجم ٢٠ ميليون
🔹نفر سوم ١٥ ميليون ث
نفرات اول و دوم: رامین موسی و سروش سرابی.
@Raminmousa
@Machine_learn
/channel/+SP9l58Ta_zZmYmY0
با عرض سلام اين مقاله اين هفته سابميت ميشه...!
Читать полностью…
Calculus 1 for Honours Mathematics
🔗 Book
@Machine_learn
Harvard's "Advanced Complex Analysis"
📓Course
@Machine_learn
🌟 OmniParser
🟡Arxiv
🖥Github
@Machine_learn
🌟 INTELLECT-1: Release of the first decentralized learning model.
PRIME Intellect has published INTELLECT-1 ( Instruct + Base ), the first 10 billion parameter language model collaboratively trained in 50 days by 30 participants worldwide.
PRIME Intellect used its own PRIME platform, designed to address the main problems of decentralized learning: network unreliability and dynamic management of computing nodes.
The platform utilized a network of 112 H100 GPUs across 3 continents and achieved a compute utilization rate of 96% under optimal conditions.
The training corpus consisted of 1 trillion public dataset tokens with the following percentage distribution: 55% fineweb-edu, 10% fineweb, 20% Stack V1, 10% dclm-baseline, 5% open-web-math.
▶️ Technical specifications:
🟢 Parameters: 10B;
🟢 Layers: 42;
🟢 Attention Heads: 32;
🟢 Hidden Size: 4096;
🟢 Context Length: 8192;
🟢 Vocabulary Size: 128256.
INTELLECT-1 achieved 37.5% accuracy on the MMLU test and 72.26% on HellaSwag, and outperformed several other open-source models on WinoGrande with a score of 65.82%.
While these figures lag slightly behind today's popular models, the results of the experiment are a critical step toward democratizing AI development and preventing the consolidation of AI capabilities within a few organizations.
▶️ GGUF quantized versions of INTELLECT-1_Instruct in 3-bit (5.46 GB) to 8-bit (10.9 GB) bit depths from the LM Studio community.
▶️ Example of inference on Transformers:import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
torch.set_default_device("cuda")
model = AutoModelForCausalLM.from_pretrained("PrimeIntellect/INTELLECT-1")
tokenizer = AutoTokenizer.from_pretrained("PrimeIntellect/INTELLECT-1")
input_text = "%prompt%"
input_ids = tokenizer.encode(input_text, return_tensors="pt")
output_ids = model.generate(input_ids, max_length=50, num_return_sequences=1)
output_text = tokenizer.decode(output_ids[0], skip_special_tokens=True)
print(output_text)
📌 Licensing: Apache 2.0 License.
🟡 Article
🟡 HF Model Kit
🟡 Set of GGUF versions
🟡 Technical report
🟡 Demo
🖥 GitHub
@Machine_learn
⚡️ MobileLLM
🟢MobileLLM-125M. 30 Layers, 9 Attention Heads, 3 KV Heads. 576 Token Dimension;
🟢MobileLLM-350M. 32 Layers, 15 Attention Heads, 5 KV Heads. 960 Token Dimension;
🟢MobileLLM-600M. 40 Layers, 18 Attention Heads, 6 KV Heads. 1152 Token Dimension;
🟢MobileLLM-1B. 54 Layers, 20 Attention Heads, 5 KV Heads. 1280 Token Dimension;
🟡Arxiv
🖥GitHub
@Machine_learn
یک هفته تا سابمیت نهایی این مقاله باقی مونده...!
Читать полностью…
Python for Everyone
🖥 book
@Machine_learn
با عرض سلام نفر سوم براي مقاله زير رو خالي داريم.
Title: Alzheimer’s disease (AD) classification
using swin transformer wavelet
and Improved Gray Wolf
Optimization (IGWO)
Abstract: Alzheimer’s disease (AD) is a slow neurological disorder that destroys the thought process, and consciousness, of a human. It directly affects the development of mental ability and neurocognitive functionality. The number of patients with Alzheimer’s disease is increasing day by day, especially in old aged people, who are above 60 years of age, and, gradually, it becomes cause of their death. In this research, our goal is to present ALzSwinTNet for Alzheimer’s classification based on FMRI images. The proposed approach uses wavelet fusion in the swin transformer network to extract features. The igwo and fox optimization approaches were used to find the hyperparameters of the model. ALzSwinTNet was able to achieve an accuracy of 0.98 in 4-class classification and 1 in 2-class classification.
journal: https://www.sciencedirect.com/journal/expert-systems-with-applications
if:7.5
هزینه مشارکت برای نفر سوم ۲۰ تومن می باشد. این هزینه صرف تسویه سرورها خواهد شد.
@Raminmousa
@Machine_learn
/channel/+SP9l58Ta_zZmYmY0
Super beginner-friendly book on Linear Algebra
🔗 Book
@Machine_learn
فقط جايگاه ٣ باقي مونده...!
Читать полностью…
با عرض سلام نفر سوم براي مقاله زير رو خالي داريم.
Title: Alzheimer’s disease (AD) classification
using swin transformer wavelet
and Improved Gray Wolf
Optimization (IGWO)
Abstract: Alzheimer’s disease (AD) is a slow neurological disorder that destroys the thought process, and consciousness, of a human. It directly affects the development of mental ability and neurocognitive functionality. The number of patients with Alzheimer’s disease is increasing day by day, especially in old aged people, who are above 60 years of age, and, gradually, it becomes cause of their death. In this research, our goal is to present ALzSwinTNet for Alzheimer’s classification based on FMRI images. The proposed approach uses wavelet fusion in the swin transformer network to extract features. The igwo and fox optimization approaches were used to find the hyperparameters of the model. ALzSwinTNet was able to achieve an accuracy of 0.98 in 4-class classification and 1 in 2-class classification.
journal: https://www.sciencedirect.com/journal/expert-systems-with-applications
if:7.5
@Raminmousa
@Machine_learn
/channel/+SP9l58Ta_zZmYmY0
📚 Deep Learning with Python Develop Deep Learning Models on Theano and TensorFLow Using Keras by Jason Brownlee
🔗 Book
@Machine_learn
با عرض سلام نفر سوم براي مقاله زير رو خالي داريم.
Title: Alzheimer’s disease (AD) classification
using swin transformer wavelet
and Improved Gray Wolf
Optimization (IGWO)
Abstract: Alzheimer’s disease (AD) is a slow neurological disorder that destroys the thought process, and consciousness, of a human. It directly affects the development of mental ability and neurocognitive functionality. The number of patients with Alzheimer’s disease is increasing day by day, especially in old aged people, who are above 60 years of age, and, gradually, it becomes cause of their death. In this research, our goal is to present ALzSwinTNet for Alzheimer’s classification based on FMRI images. The proposed approach uses wavelet fusion in the swin transformer network to extract features. The igwo and fox optimization approaches were used to find the hyperparameters of the model. ALzSwinTNet was able to achieve an accuracy of 0.98 in 4-class classification and 1 in 2-class classification.
journal: https://www.sciencedirect.com/journal/expert-systems-with-applications
if:7.5
@Raminmousa
@Machine_learn
/channel/+SP9l58Ta_zZmYmY0