Hi, lugia, it's nice to see you trying to learn. I'm not the best person to give tips but for supplies, like kaetana said, do whatever you felt comfortable. If you still learning to do basic, Pencil and paper plus eraser is usually enough, but pen for lining do can get important after you at least master pencil. There's some good pens like sakura pigma pens with different thickness you can try (the price is okay enough). If you want to breach into coloring, just grab some cheap color pencils. I like using Faber caster.
I learnt it mostly autodidact (since my school art class is c*ap), but if you want to draw standard anime Style, you can go to ibis paint YouTube channel. It was made specifically for a phone/tablet app called ibis paint X, but you can use it to learn on paper too! There's many useful video of how to draw head, body and such.
If you want to start with digital, I would suggest you get a Medibang or ibis paint and try drawing on your phone/tablwt first to get the hang of it. Most program have the similar function so you'll get there quickly. But be careful that your eyes, hands and back might be hurting the few first time (or even long after) you use it.
If you have PC and a tablet to draw ready, free option like Medibang is good enough to learn. I started using phone for around a year or two before I got an iPad.
For drawing, what I would really suggest you do first is to get used with your pencil. Make some shapes and lines or whatever to get the hang of it maybe 5 to 15 minutes if you like, and then just draw whatever you like. If you want to draw figure, I would recommend you to use help lines ( Forgot what it's called) like you see on the usual how to draw humans liked if help lines. Trust me, that's one thing you need if you're a beginner. I'd you were very used with your drawing, you might not need it anymore, but I say that it's mostly reserved to the pro, so don't think too much about it.
(okay, so it's like these lines is what I'm talking aboit. Just don't follow my example lol)
I guess as much I can gave you. Hope it's help a little.