Expertise Sidelined into Management

In the growth of my current organization (20 to 100 employees, over 6 months) we end up being pushed from being experts into management roles. We did not pay attention to expertise movement taking expertise out of circulation.