In 'Coding by Magic', the author discusses their curiosity-driven approach to programming, focusing on understanding the context of a piece of code. They emphasize the importance of tools like 'find usages', 'go to declaration', and 'go to implementations' in piecing together the code's role within the entire application.