Abdominal aortic aneurysms (AAAs) evolve over time, and the vertebral column, which acts as an external barrier, affects their biomechanical properties. Mechanical interaction between AAAs and the spine is believed to alter the geometry, wall stress distribution, and blood flow, although the degree of this interaction may depend on AAAs specific configurations. In this study, we use a growth and remodeling (G&R) model, which is able to trace alterations of the geometry, thus allowing us to computationally investigate the effect of the spine for progression of the AAA. Medical image-based geometry of an aorta is constructed along with the spine surface, which is incorporated into the computational model as a cloud of points. The G&R simulation is initiated by local elastin degradation with different spatial distributions. The AAA–spine interaction is accounted for using a penalty method when the AAA surface meets the spine surface. The simulation results show that, while the radial growth of the AAA wall is prevented on the posterior side due to the spine acting as a constraint, the AAA expands faster on the anterior side, leading to higher curvature and asymmetry in the AAA configuration compared to the simulation excluding the spine. Accordingly, the AAA wall stress increases on the lateral, posterolateral, and the shoulder regions of the anterior side due to the AAA–spine contact. In addition, more collagen is deposited on the regions with a maximum diameter. We show that an image-based computational G&R model not only enhances the prediction of the geometry, wall stress, and strength distributions of AAAs but also provides a framework to account for the interactions between an enlarging AAA and the spine for a better rupture potential assessment and management of AAA patients.