I just went to yourrootpath/qa-include/qa-page-ask.php and removed the portion below (towards the bottom of the page)
'content' => array_merge(
$editor->get_field($qa_content, @$incontent, @$informat, 'content', 12, true),
array(
'label' => qa_lang_html('question/q_content_label'),
'error' => qa_html(@$errors['content']),
)
),
Seems to work. That will just have the question, tags and email on answer option.