Sigmoid

BlogsAbout
Blogs of #machine-learning
All mathematicsmachine-learningstatisticsthoughtsinvestmentgame-theorycryptographyalgorithmcomputationCC++LHPAOSfrontend
Nonlinearity with Activations
Linearity requires additivity and scaling, but neural networks need nonlinearity to break free from simple affine transformations. While affine layers only stretch and rotate data without changing its topology, activation functions enable complex reshaping—allowing networks to untangle data manifolds and learn intricate patterns effectively.
#mathematics, #machine-learning
2026, April, 06
12
Copyright © 2020-2026 Ethan Zhang. All rights reserved.
AI Policy RSS Feed Sitemaps Sponsor