Jesus, lead us with Thy power. W. Williams. [In Temptation—Security in Jesus.] Published in his Gloria in Excelsis; or Hymns of Praise, &c, 1772, No. 35, in 3 stanzas of 8 lines In modern hymn-books it is usually given as "Jesus, lead me by Thy power." Original text in Lord Selborne's Book of Praise, 1862.
--John Julian, Dictionary of Hymnology (1907)