Explorations in Innovative Science

Born of Silence, Moved by Thought A poetic reflection on existence, evolution, and the quiet questions we carry. We came with breath, but not with map, No whisper told us why and how. A body moves, a mind that pokes— Yet all is given, none avow. We eat, we sleep, we laugh, we cry, The heartbeats count, never know why. Whose hands designed our eyes and minds, If plans were made, likely ’d been told, No draft to sign, no path to trace. Trial and error in time and space, Halfway through, we would never know. Some say God—a sculptor kind— Shaped the clay and breathed the spark. Others claim the stars collided, And life arose within the dust. Some sought a script, a random seed, To mimic logic in life-form's code. But runs fell short by countless years— Too few were born for what hearts behold. Perhaps the path was not all chance, But shaped by truths we’ve yet to yield— A quiet rhythm underneath, Unknown, yet ever in the known. Who placed the co...

  Date :May 21, 2025 Over the past week(s), I’ve embarked on an intensive experimental journey combining genetic programming (DEAP) with neural network activation function design . The result? A utility that evolves custom activation functions capable of outperforming standard choices like ReLU, Swish, or GELU under certain conditions. This post serves both as a personal milestone and a timestamped record of this research. 🔍 Project Overview Using DEAP (Distributed Evolutionary Algorithms in Python), I constructed an evolutionary search space made up of elementary mathematical primitives and safe variants of functions like log , sqrt , and divide . The system: Evolves TensorFlow-compatible activation expressions Benchmarks them in a real model loop (e.g. CNN-based classifier) Reports performance via loss, runtime, and memory usage Filters out invalid or exploding functions during evolution 🧠 Notable Results One evolved function recently outperformed sta...