Obviously you can’t learn (or teach) everything at once ... but you have to start somewhere. This leads to two important questions: (1) where to start, and (2) when to move on to the next topic.
To answer such questions, the only thing that has ever made sense to me is the following:
Spiral approach: Learn a few rough ideas, then spiral back, making connections between the ideas. Then keep spiraling back again and again, gradually adding new ideas, refining the ideas, and making more connections, checking to see in what ways each idea is consistent (or inconsistent!) with the others.
Therefore the answer to question (1) is that the startingpoint doesn’t matter very much. After a few trips around the spiral, nobody knows or cares where it started.
Question (2) is superimportant, because it will come up again and again, every day for the rest of your life. Each time, the spiral approach provides a partial (but not complete) answer. It says that you do not need to master one topic before moving on to the next. Plan on coming back.
The spiral approach stands in contrast to the 2000yearold axiomatic / deductive approach, where topics are arranged in some monotonic order, and the student is expected to master each topic before moving on to the next. As discussed in section 4, the axiomatic approach is a bad idea. The more rigidly it is applied, the worse it is. It may seem elegant or rigorous, but it is not the way people learn or think.
Suppose somebody wanted to learn long multiplication before they had fully mastered basic short multiplication facts, aka the “times tables”.
That’s actually not a problem. In the worst case, if they had to refer to an actual nonmetaphorical 10×10 shortmultiplication table while doing their long multiplication exercises, it would not be the end of the world. It would slow them down, but not fatally.
Forsooth, the shoe is pretty much on the other foot: Doing a bunch of longmultiplication problems provides opportunities, motivations, and reasons to learn the basic shortmultiplication facts.
The point here is simple: It is absolutely not necessary to master things at one level before moving on to the next level. Any topic of real importance will come up again and again, in various natural contexts, so there will be lots of opportunities to refine the ideas. This is sometimes called successive refinement. It is also called the spiral approach.
Consider the following twopart story:
Pointing to various features of the diagrams, he said something like "Opencircuit voltage, shortcircuit current, linear circuit, two points determine a line. Thévenin equivalent, Norton equivalent. Same blackbox behavior. Useful. Know it."
The whole presentation took only a minute or two. Nothing more needed to be said that day. Many of his sentences didn’t even have verbs. In particular, he did not take time to make sure that the students mastered the concept before moving on.
The students looked at his diagram and nodded. Opencircuit voltage. Shortcircuit current. Two points determine a line. Sounds plausible.
In the unlikely event that some student initially acquired a defective understanding of such circuits, that defect would have been cured naturally sooner or later, probably sooner, because equivalent circuits are indeed useful, and get used again and again and again. One of my favorite sayings is:
That is to say: Stuff that gets used gets remembered.
Just to make doubleespecially sure everybody understood it before moving on, he assigned hours of homework on the subject. Students were required to analyze some cockamamie circuit with lots of resistors and lots of batteries.
Just to make tripleextra sure that everybody understood it before moving on, there was a big lab assignment. Students were required to actually build the cockamamie circuit and measure it, comparing against the Thévenin and Norton predictions. For at least two idiotic reasons (as discussed in section 7.2) the observations did not match the predictions.
The upshot was that these students came away with the idea that Thévenin and Norton equivalents were horribly complicated and useless.
So you see, the two schools led their students to dramatically different conclusions.
The point of this parable is simple: It is absolutely not necessary for students to master an idea before moving on. Instead, one can use the spiral approach: Introduce the subject lightly, then move on to other topics, then come back and revisit each topic, tying everything together. If the supposedlyimportant ideas really are important, they will come up again and again, in the normal course of business.
As the travel guidebooks say: When planning a trip to the big city, do not plan on seeing every single museum on your first trip. Assume you will come back. Assume your first trip is not the only trip.
Most of this article is about how to take a complex topic apart and then, later, put it back together. However, in some situations, especially with students who are seeing the topic for the first time, it pays to provide some sort of overview / survey / synopsis.^{1} This is analogous to peeking at the picture on the box that the jigsaw puzzle came in. It provides some perspective and some indication of how the various pieces fit into the big picture. This helps motivate folks to learn about the pieces.
This involves some tricky judgment calls, because there are limits. Sometimes the big picture can be intimidating and overwhelming.
When it comes to learning (and teaching), it doesn’t pay to worry too much about the order in which ideas are presented.
Instead, it makes sense to use a spiral approach. That is, we start by mentioning a bunch of rough ideas, including some applications as well as some fundamental buildingblocks. Then we go over everything again, making connections between the ideas, refining the ideas, discussing things in more depth, and introducing some new ideas. And so on, iteratively.
By the time you have made the Nth turn around the spiral, nobody cares – or even remembers – where you started.
See reference 1 for an insightful discussion of how thinking and problemsolving are done. This includes an interesting specific example, namely proving the uniquefactorization theorem ... but the process is even more interesting than the result. Also reference 2 is a classic, highlyregarded discussion of problemsolving techniques. Additional discussion can be found in reference 3.
I like to tell students:
You’re not Superman, and I’m not Superman either. I can’t teach you how to leap tall buildings in a single bound. I can however show you where the stairwell is. We can get to the top one step at a time.
Feynman compared knowledge to a grand tapestry. Any unknown fact is like a hole in the tapestry. The hole can be repaired by weaving upward from the bottom, downward from the top, or inward from the sides. I would go even farther and point out that you can start in the middle of empty space and weave new fabric from scratch, and then patch it into to the main tapestry later. Furthermore, real problemsolving involves a great deal of exploring avenues that turn out to be dead ends, and then backtracking.
Actually there are even more options than that, because the network of knowledge is very highdimensional, not just twodimensional like a tapestry. Ideas are connected in many, many different directions.
In introductory textbooks, many of the endofchapter problems can be
solved in a single step. Because there are so few steps involved,
there are few things that can go wrong. 
This stands in contrast to realworld tasks, which are exponentially more complicated. For instance, one of my hobbies is teaching people to fly airplanes. When you are landing the airplane, there are at 12 major things you need to keep track of, and at least 3^{12} ways that things can go wrong. That’s a rather big number, more than half a million. Furthermore, there is time pressure: all 12 variables must be controlled in real time. 
When teaching realworld skills, it is essential to use the buildingblock approach. That is, we break the overall task into modules, into small buildingblocks. Then we teach a few of the blocks in isolation, and then gradually combine them, two at a time, then three at a time, et cetera. Then we spiral back and add a few more blocks. Eventually we combine everything to create the final complete edifice.
The wise teacher will not only use this approach, but explain the process, so that students can internalize it. That is to say, the topic of problemsolving skills is worth discussing explicitly. Later, when they are on their own, when they encounter a hard problem, students will be prepared to chip away at it, breaking it into a large number of manageable subproblems, and then combining the subresults.
The final step – putting things together – must not be omitted. Dealing with the blocks one by one is a fine place to begin, but it is not an acceptable place to end!
The maze metaphor is discussed in reference 4.
As a general rule:
With rare exceptions, the teacher should not require that a problem be solved a particular way. Nonstandard methods should be tolerated, within reason. There is a continuum, ranging from creative, indirect, roundabout, or peculiar to outright bizarre and perverse.
If you want to give students practice with a particular method, choose examples where that method is clearly preferable. If the method is any good, such examples should be easy to find.
For the next level of detail, see reference 5.
The spiral approach is dramatically different from what might be considered the “traditional” axiomatic approach. Consider the following contrast:
Some folks may be motivated to learn just by the love of learning.  Others require more motivation. For example, they may want to see some practical applications. 
Some folks are very patient and trusting. They believe it when they are told that the stuff they are learning will be useful somehow, some day.  Others are more impatient and skeptical. They start out skeptical as children, and become more and more skeptical as they grow up. In my opinion, this is entirely reasonable. 
According to legend, Euclid mocked a beginning student who dared to ask what geometry was good for. See section 7.1.  I say students should ask what stuff is good for, and demand straight answers. 
For approximately 2300 years, in school in general and in
math class in particular, the typical practice has been to assume that
the following three things are equivalent:

There is not the slightest evidence that such things
are equivalent. 
When publishing a formal proof, you start with the axioms, use that to prove some lemmas, use that to prove some simple theorems, use that to prove some fancier theorems, and so forth. At the very end, after you have learned all the tools, you might get to see some realworld applications. It’s all very straightforward.  In the real world, you almost never know what tools might be useful until after you have seen the problem. When a hard problem lands on your desk, it is a mad scramble to gather possiblyuseful tools and learn possiblyuseful techniques. You won’t know which tools were actually needed until after the problem is fully solved. There is nothing straightforward about it. 
This can be called the Euclidean axiomatic / deductive approach. 
This approach works fine if all you want to do is check the correctness of a given completed proof.  This is almost never the right approach if you are faced with a problem and trying to invent a solution, as pointed out in e.g. reference 2. 
It is also almost never the right approach to learning (or teaching) a given subject. 
The strictly deductive approach may be an elegant way of formalizing a mathematical result for presentation in a scholarly journal.  It is not how new, original mathematical results are obtained, and it is not how mathematical ideas are learned, especially at the introductory level. 
Furthermore: Just because the straightforward approach is bad does not mean that the straightbackward approach is good. As usual, all the extremes are wrong. For learning and teaching, some version of the spiral approach and/or the buildingblock approach is usually a good idea, as discussed in section 3.2 and section 3.5. In a more general problemsolving situation, where there is no teacher (i.e. no one who knows what the right answer is) the situation is even more fluid. You have to come at the problem from many different angles.
Some folks (including Sal Khan) argue against the spiral approach. They assert that it is vital to achieve a a «solid» understanding of one topic before moving on to the next. They consider a nonsolid understanding to be dangerous. Khan explicitly compares it to a broken bone.
I apply the bone analogy differently: Real bones have hollow parts and, even more remarkably, cancellous parts, as shown in figure 6 (from reference 6).
Cancellous bones (aka cancelate bones) work better than any corresponding «solid» bone would work, in terms of strengthtoweight ratio, growth rate, and other critical measures. Nonmetaphorically speaking, even if you think a «solid» understanding is the ultimate goal, it is better to lay down a preliminary cancellous structure, and then spiral back to fill in whatever gaps really need filling. In terms of pedagogical sequencing, the only thing that has ever made sense to me is the spiral approach. Don’t assume that the first exposure to a topic will be the last.
Here’s another set of contrasts for you:
At a typical university, there is a “Composition and Orchestration” course. Music majors are required to take this course. It is a very demanding upperdivision course.  Typically there is also a “Music Appreciation” course. The students are not musicians. They listen to a performance of the music, and then discuss what they’ve heard. This is not a very demanding course. Music majors are not allowed to take this course, not for credit anyway. 
Let’s be clear: Listening to a piano sonata is one thing. Performing one is something else entirely. Composing one is something else yet again.
Gauss made a point of removing any trace of the process by which he reached his results. He justified this by saying, that no architect would, after completing a building, leave the scaffolding in its place. 
Gauss’s approach might make sense if you think you are performing in front of an audience. That would make sense in the context of a superficial “math appreciation” course.  It makes no sense if you want learn how math is actually done, if you want to be a performer or (gasp) a composer ... or if you want to teach such skills. 
I mention this because in some fields, the textbooks tend to be elegant and highly polished. This has been the practice for thousands of years, continuing to the present day. They discuss the most elegant solution, without discussing how the solution was actually found, i.e. the messy process of proceeding upward from the bottom, downward from the top, inward from the sides, and outward from the middle, with lots of backtracking, finding an inelegant solution and then gradually refining it.
In the real world, in any sort of engineering situation, you are required to show the work. That includes keeping the scaffolding in place, or at least keeping it close at hand. This is often not easy to do, but it is required so that others can validate, maintain, repair, reuse, and extend your work. For the next level of detail, see reference 7.
According to legend (as quoted in reference 8), a new student of Euclid’s once asked him, “What shall I get by learning these things?” In reply, Euclid beckoned his slave and told him, “Give him a coin, since he must make gain out of what he learns”.
This is a horrifying story. A student who asks what something is good for should be encouraged. A student who asks how something fits into the big picture should be encouraged. Teachers should be prepared to answer such questions. Euclid may have been a good mathematician, but in my opinion he was not a good teacher, if the legend is to be believed. In any case, apart from the legend, Euclid’s book says almost nothing about motivations or applications.
In case you were wondering how it was possible to screw up something so simple as Thévenin and Norton equivalents, as discussed in section 2.2, here’s next level of detail.
The school was too cheap to buy 1% precision resistors, which cost about a penny apiece. They thought their students didn’t deserve that kind of luxury. So they used 10% resistors instead. The cockamamie circuit contained a large number of resistors, so the uncertainties accumulated. What’s worse, the assignment required students to measure a voltage that was a small difference between large numbers, which made the relative uncertainty enormous.
Secondly, although the homework calculation used ideal batteries as voltage sources, the lab project used bench power supplies. It turns out that a battery puts out a moreorless constant voltage over a wide range of positive and negative currents, whereas an electronic power supply does not tolerate negative currents. As Murphy’s Law would have it, the cockamamie circuit was trying to run negative current through one of the power supplies. So the observed behavior of the circuit bore absolutely no resemblance to the homemwork calculation.