How do you define high rise building.. Normally, 1-3 stories (low rise) 4-12 stories (mid rise) 12 to 40 stories (high rise) and 40 stories upward (skyscraper). For High rise building construction, you will see a huge crane standing firmly together with the building they build. They are normally called tower crane.. but for congested site, they might applying the luffing tower crane.