Born in Atlanta's Grady Hospital in 1941 to truck driver George Arrington and domestic worker Maggie Arrington, Judge Marvin Arrington spent his formative years in some of Atlanta's poorest in-town neighborhoods, including the Grady Homes public housing project. Church and community activism were prominent influences in young Marvin's life. He joined the Lindsey Street Baptist Church at an early age.

Arrington's childhood was full and productive as he held down part time jobs on weekends, managed his own paper route and helped his grandfather deliver fresh vegetables along Peachtree Road. Marvin participated in youth activities at the Butler Street YMCA and was a Boy Scout. The Arrington family unit was poor but provided a stable and nurturing environment for Marvin and his siblings Joseph, Elaine, Audrey and Cynthia.

At Turner High School, he quarterbacked the football team among other activities. His on-field successes along with his dedication and determination won him an athletic grant to Clark College (now Clark Atlanta University). At Clark, Arrington immersed himself in campus life enriching with fraternity and other social and community activities in addition to academic requirements and football. He has maintained many of the relationships from his Clark College days including his Kappa Alpha Psi Fraternity brothers.