A few months after his arrival in the Land of Israel, on the 11th of Tammuz, Rabbi Aryeh married Hannah, the daughter of Rabbi David Shapiro, the brother-in-law of Rabbi Tzvi Pesach Frank. Rabbi Aryeh settled in Jerusalem, studied at the 'Torat Chaim' Yeshiva, and in the year 5669 (1909), he was ordained as a Rabbi by the esteemed Rabbis: Rabbi Chaim Berlin (son of the Netziv of Volozhin), Rabbi Shmuel Salant, and Rabbi Abraham Isaac HaCohen Kook, whose souls were deeply bonded with his. From the year 5677 (1917) until the end of his days, he served as the spiritual supervisor (Mashgiach Ruchani) at the Talmud Torah adjacent to the Etz Chaim Yeshiva in Jerusalem.
Rabbi Aryeh was called 'Reb Aryeh' by everyone and was known by his moniker, “The Rabbi of the Prisoners,” because he habitually went to the inmates in the prisons for about twenty-five years during the British Mandate period, encouraging their spirit and writing letters to them. His visits to the underground prisoners and those executed on the gallows were especially renowned. Reb Aryeh also regularly visited the leper hospital to encourage its residents. When asked why Rabbi Kook, of blessed memory, specifically recommended Rabbi Aryeh to the prison authorities to be the Rabbi of the prisoners, he replied: "Rabbi Aryeh possesses the quality of performing physical acts of kindness (Gomel Chesed B’Guffo), and herein lies the secret of his soul and his rectification in the world." Rabbi Kook also said of him: "If there were three Jews like Rabbi Aryeh in our generation, the Messiah would come..."
His good character traits, humility, love for all of God's creatures, and the acts of kindness he performed with every person in need were famous in Jerusalem. He lived modestly and under poor conditions, refusing every offer from his admirers to improve his living situation. He once told a friend during a funeral in Sanhedria: "Many times they tried to persuade me to move my apartment to a more spacious place, and I refused. Go and see: after a long life, a person is brought from his apartment to here [the cemetery]. For me, the transition will not be difficult, because from my room to here there is no sharp contrast..."
His face shone especially when he met children. Once, when he left his home, Rabbi Aryeh approached the children and stroked their faces with paternal affection, saying to his escort: "If it is a mitzvah (commandment) to desire and favor the stones and dust of the Land of Israel, as the verse in Psalms states: 'For Your servants cherish her stones and favor her dust,' then it is all the more so concerning the children of Israel in the Land of Israel..."
Many stories were connected to the Jerusalemite righteous man, Rabbi Aryeh Levin, and were extensively recounted in two books by the author Simcha Raz: Ish Tzadik Haya ('He Was a Righteous Man') and Tzadik Yesod Olam ('Righteous Foundation of the World'). The book includes a story that occurred a few hours before Rabbi Aryeh's passing. When the journalist Eliyahu Amikam approached him, Rabbi Aryeh pointed to the Book of Psalms in his hand, and to the verses: "He will save Zion and build the cities of Judah... and those who love His name shall dwell there." Rabbi Aryeh explained: "First, 'He will save Zion'—first came the Biluim [early pioneers] and then their successors. Now we are in the second stage—we must build the cities of Judah, and only then will the third period arrive—the love of God... That period too will come..."
The numerous stories about him overshadowed another facet of his personality: Rabbi Aryeh was a profound Torah scholar with a huge and extensive scope of knowledge, and a trusted confidant of the great sages of Israel who held him in great esteem and respect. Throughout his life, he did everything to hide and conceal his greatness, but in his will to his descendants, he guides them in the ways of life, revealing a little of his inner world so that his words would be accepted by their hearts, and asks them to follow the paths he paved, sometimes through devotion and sacrifice of all he owned for the sake of others.
Rabbi Aryeh embodied the concept of "Fleeing from honor" and did so with all his might. When they wanted to grant him the title of Worthy Citizen of Jerusalem (Yakir Yerushalayim)—he refused. Many good people pleaded with him to agree, but he refused and did not give a reason. "I saw and considered that it is not worthwhile to strive to obtain a position or to force the time. For you will be called by your name and seated in your place. And from your own [portion] will they give you..."
Once, he was asked about the matter, and in a moment of candid disclosure, he answered: "One does not open a window in a dark house." (Meaning that when the house is dark, its deficiencies cannot be seen, as it is dark inside. But when the window is opened and the light comes in, all the deficiencies will be revealed...) Such was Rabbi Aryeh in his humility and discretion; he was sure he was unworthy, and on the contrary, the honor would only expose his shortcomings to the public.
"I always strove to be among those who are insulted but do not insult, who hear their disgrace but do not reply, and immediately I prayed that no one would be punished because of me..."
The preeminent Rabbi Zilberstein, Shlit"a, the husband of his granddaughter, related: "Once, while the Rabbi was giving a lesson, President Zalman Shazar, of blessed memory, arrived and asked to speak with him. When his messenger entered and delivered the request, the Rabbi replied: 'I am currently engaged in Torah study. If the matter is one that supersedes Torah study, I am willing, but if not, please postpone the meeting until tomorrow.' And indeed, the President left, and the next day the following story came to light: Because there was a ceremony for the pardoning of prisoners, in which the Chief Justice of the Supreme Court of the United States participated, he turned to one of the prisoners and asked him: 'Will you continue to steal in the future?' The prisoner thought for a moment and answered: 'Only one thing (or one time). I need to 'obtain' a watch for Rabbi Levin, because he does not have one!' To the guest's astonishment, the prisoner explained that Rabbi Aryeh Levin had taught them in prison about the virtue of truth, and his words had so penetrated his heart that he had resolved not to steal anymore to avoid the lies stemming from concealing and denying the act, and thus he could no longer steal. But he so deeply valued and admired Rabbi Levin that he wanted to give him a wristwatch, which the Rabbi lacked. The guest was so impressed by the story that he requested to meet Rabbi Levin. He accompanied President Shazar to meet the Rabbi, and because the matter did not justify interrupting the Torah study, the President postponed the visit until the next day!
Rabbi Aryeh Levin passed away on the 9th of Nisan, 5729 (1969), and was buried in the Sanhedria cemetery next to his wife's grave. Even in his will, Rabbi Aryeh continued to care for the entire people of Israel: "All those to whom I was connected in my life, especially those who drew close to me in closeness to God and whose distress and suffering I felt, I will not forget them, if I have any merit after twelve months to ask for mercy before the Throne of Glory..."