Improving physical activities is one of the most important things after orthopedic surgery. According to Statistics Canada, By 2031, close to one in four Canadians (23%) could be 65 years of age or older. Over the past 5 years, the number of orthopaedic surgeries has increased by 17% in Canada. Unfortunately, because of limited time, non-adherence, lack of engagement, and private clinic costs, most of the people do not go to the clinic after surgery and do not adhere to their physical rehabilitation exercises. Our approach is to develop a real-time interaction system to improve physical rehabilitation after surgery by using motion detection techniques.