The global pandemic caused by the COVID-19 has profoundly changed the daily life of most of the world population. People with disabilities have been particularly affected by these changes, which often have accentuated their isolation and marginalization also due to greater difficulties in accessing healthcare services. People with disabilities have also been impacted in relation to their ability to participate in physical activity with even more adverse consequences for their quality of life and health. The aim of this study was to explore the impact of the COVID-19 pandemic on physical activity practice of people with disabilities and to understand the changes that caregivers have perceived for the participation in physical activity of this specific population. It emerged that, regardless of the type of disability, people with this condition experienced drastic reductions in their physical activity levels during the pandemic and in most cases did not have access to any type of remote guidance. Furthermore, a higher prevalence of sedentary behavior and negative changes in eating habits have been reported by the caregivers, highlighting the need for specific strategies and initiatives for people with disabilities to maintain healthy habits and a physically active lifestyle.