Basically, a widget is a type of plugin. "Plugin" is the general name for various different types of extensions, including widgets, page plugins, filters, function overrides, etc.
A widget is essentially a piece of content that is placed at one of several locations on the page (e.g. in the sidebar or at the bottom).