Here is the family tree which originates from James’ brother, Walter (1855). 

Thanks to Don Lawson, of Toronto.