LookingForTroubleQ

joined 1 year ago
 

6 bit for now - having strange llama memory issues with 8 bit even though plenty of GPU mem. It is also somewhat throttled response

It is uncensored so use at your own risk !!!

You can put prompt hints in parentheses brackets stars etc https://projectatlantis.eu.ngrok.io/chat.html

Curious how ppl think it compares to smaller models