How much physical space do you have and what are your hoarding habits?
If you want to save everything you make so you can see progress down the line, physical art requires places and containers to store not just materials (paints, brushes, colored pencils, pens, paper) but space to store the finished works (canvases, paper, ect ect). And if you lack the space for either of these things then you'll have a tougher time. Worse if you plan to keep everything including doodles.
As a note for starting traditionally buy a stack of printer paper or a cheap 8x10 notebook from a dollar store. It's cheap paper and is good for getting started with doodles and practicing. I personally have a giant box of printer paper from a bulk store I bought in 2007 and I'm only halfway through it, and that's with printing out lots of essays in college with that paper.
If you have better organizational skills digitally (files, templates, folders) then try that first. You would ideally need to invest in a tablet of some sort or a pen-accepting touch screen.
Overall my personal approach has been: use printer paper and such for doodle works that I don't care about (draw 50 hands and 50 feet, ect ect) so I can throw them out later. I only keep expensive papers and have 2 different boxes and containers set aside to hold the finished works. I use what amounts to a tackle box to store my paints and brushes in, and my colored pencils are in a large plastic tub. Digitally, I have folders set up for: Art, OCs, Fanart, Promo materials, and so on. Or are titled as such. I know I'm the type who wants to keep everything I make, or wants to catalogue it in some way, so I have been submitting both doodles, works in progress, and finished works to my deviant ART account for years. When tumblr came around I started posting more wips on there, and then have been transferring that stuff to instagram lately. Overall though, even with it's changes to the layout, devART is still the best portfolio tool digitally for organizing your stuff into categories and folders. Photobucket would be a close second except now that it has limitations and requires a subscription, it's less so. Imgur is similar in that it "would" be good except that organizing on that site can also be a pain in the butt.