In this paper, a novel multiscale hierarchical model based on finite element analysis and neural network computation was developed to link mesoscopic and macroscopic scales to simulate the bone remodeling process. The finite element calculation is performed at the macroscopic level, and trained neural networks are employed as numerical devices for substituting the finite element computation needed for the mesoscale prediction. Based on a set of mesoscale simulations of representative volume elements of bones taken from different bone sites, a neural network is trained to approximate the responses at the meso level and transferred at the macro level.