Described by the Bishop as "A very gem of architectural beauty" the building was completed in 1854 and provided a continuing spiritual foundation in an otherwise deprived area.The introduction of Sunday schools and frequent choir recitals ensured that the church played a much needed and important part in the lives of its people. The attendance remained steady through the first 20 years and in this time a total cost of £1500 had been spent in managing needy repairs to the building as well as £1600 for the installation of a new organ. This money was made available by the ever willing congregation who did their best to help in donating what they could.
The commencement of the First World War brought with it a change in fortune for the church. New buildings previously bought for the construction of a larger church were needed to aid in the war effort and many of the church's congregation were also required for the armed forces or munitions work. This resulted in a decline of church income and also a change in support for the church. Throughout the following years, talk of a new church was always on the minds of the congregation but circumstances always seemed to be against this dream.
The end of the Second World War enabled the then Rector, Canon Fred Drake to return a stable and healthy life back into the church and its people. After the war, attendance increased back to the numbers previously witnessed and with this, Boys Brigade and various summer camps became very popular. With the continual increase in church activities perhaps the most influential event in St Mary Magdalene's history came about in Feb 1952 when, under Cannon Fred Drake, A new home was made available at the site of Constitution Road for a generous price of £5000. To celebrate the move, the opening service was held by the Bishop of Edinburgh, the Right Rev. Kenneth Warner on Feb. 13th 1952.
Soon after the purchase of the new church, needy repairs to the buildings were becoming a strain on the financial resources and this was not made easier by the rise in unemployment and consequent decline in collections. This much needed restoration was also prevented by the building of a new carriageway through the old graveyard and it was decided that the work should be left until the road was completed. With the continuing poverty of the era the survival of St Mary Magdalene was put into question and against the odds the people of the church fought for its survival and the funds to meet the repairs: It proved to be a worthwhile cause.
1979 brought Rev David Shepherd to the church and with him the desire raise the church from its dormant state. Thanks to an anonymous donation of £2000, council grants and other monetary gifts the much needed restoration was finally made possible. Armed with the attitude "if in doubt, throw it out", rubble from previously unused rooms was soon cleared and work began on restoring the battered stonework and stain glass windows.