CalibAI: Unambiguous, Transparent AI Skill Benchmark and Assessment

Is this just a baity way to collect data from people ?

Visually, it is appealing! My intent isn't to sound negative, but you asked for feedback, and I was mostly confused by the questions. Please bear in mind I can be unintentionally more literal than expected, but I'm not the only person like this. I'm also not an idiot, promise! Well, probably. :) It's more that I'm trying to understand what you're looking for with the questions to figure out how to answer when more than one response fits. For example, the initial question isn't mutually exclusive, but you only are looking for one result, and I'm not sure which one matters most to you. Either tighten the question, or make it a 'check all that apply'. My answer would be that I am an employee who uses AI. I lead a team at work (and that team uses AI). I also use it in my free time. Second question is about how often I use AI. You'd think this isn't confusing, but "Every day; it's part of how I work now" as one of the answers ... I do use it every day because I use it for free time projects *and* at work. I don't work literally every day. The reuse question is very confusing to me. Which answer would I use for spec-driven development? I make specs, but they aren't reusable because why would I ask it to do a part of the project it's already done? Context question is a bit better in that I think I can tell what you're trying to know if I ignore some of the wording. But ... and I'm sorry to be like this but I really can't help it ... the AI never knows you until you send the first message because all the stuff doesn't get loaded until that happens. So when you open a new chat, it never knows anything until after you send a message. And it still only knows anything about me/how to work with me because all that stuff gets incorporated into the context (as long as the harness is working). Systems question is similar to the reuse question. I use specs, they save me time (most days :P), but they aren't repeatable because why would I ask for it to fix the same bug twice, or add the same feature twice? I suppose the process is repeatable, but that's not what the question asked. Reach was fine. Autonomy... oh dear. I think I understand, but I'm having trouble classifying "I ask it to load the current task file and keep an eye on it after it gets started to make sure it isn't going sideways". That sort of seems like the first option, because I think what you're looking for is scheduling. But it still makes plenty of (autonomous) decisions when coding, and sometimes it doesn't need input, so I check the results. At the end now, and who pays for AI... my company pays for my work account, but I pay for my accounts outside of work?

Visually, it is appealing! My intent isn't to sound negative, but you asked for feedback, and I was mostly confused by the questions. Please bear in mind I can be unintentionally more literal than expected, but I'm not the only person like this. I'm also not an idiot, promise! Well, probably. :) It's more that I'm trying to understand what you're looking for with the questions to figure out how to answer when more than one response fits. For example, the initial question isn't mutually exclusive, but you only are looking for one result, and I'm not sure which one matters most to you. Either tighten the question, or make it a 'check all that apply'. My answer would be that I am an employee who uses AI. I lead a team at work (and that team uses AI). I also use it in my free time. Second question is about how often I use AI. You'd think this isn't confusing, but "Every day; it's part of how I work now" as one of the answers ... I do use it every day because I use it for free time projects *and* at work. I don't work literally every day. The reuse question is very confusing to me. Which answer would I use for spec-driven development? I make specs, but they aren't reusable because why would I ask it to do a part of the project it's already done? Context question is a bit better in that I think I can tell what you're trying to know if I ignore some of the wording. But ... and I'm sorry to be like this but I really can't help it ... the AI never knows you until you send the first message because all the stuff doesn't get loaded until that happens. So when you open a new chat, it never knows anything until after you send a message. And it still only knows anything about me/how to work with me because all that stuff gets incorporated into the context (as long as the harness is working). Systems question is similar to the reuse question. I use specs, they save me time (most days :P), but they aren't repeatable because why would I ask for it to fix the same bug twice, or add the same feature twice? I suppose the process is repeatable, but that's not what the question asked. Reach was fine. Autonomy... oh dear. I think I understand, but I'm having trouble classifying "I ask it to load the current task file and keep an eye on it after it gets started to make sure it isn't going sideways". That sort of seems like the first option, because I think what you're looking for is scheduling. But it still makes plenty of (autonomous) decisions when coding, and sometimes it doesn't need input, so I check the results. At the end now, and who pays for AI... my company pays for my work account, but I pay for my accounts outside of work?