Conf42 Prompt Engineering 2024 - Online

- premiere 5PM GMT

Exploring Copilot Capabilities

Video size:

Abstract

Copilot is the big announcement of 2024 within Microsoft. For some, it’s just a fancy Bing search; for others, it’s their new friend, colleague, and peer tutor. Learn in this session from Peter De Tender, Technical Trainer at Microsoft Redmond, what Copilot can do for you in your day-to-day job.

Summary

Transcript

This transcript was autogenerated. To make changes, submit a PR.
Hi, everyone. Welcome to this Conf42 Prompt Engineering Conference. And even more welcome to my session topic on exploring co pilot capabilities. Now, for today, we have, about 45 minutes presentation time, where I'm going to try and show you quite some demos to keep it a little bit entertaining. Now, in short, although the main topic of the conference is prompt engineering, I actually wanted to take it one step further and talking about how to actually use prompt engineering using Microsoft Copilot and not only in like web or work like M365, but actually giving you a walkthrough of what it different co pilots, are available today within Microsoft. Now I'm going to start with a quick overview, what generative AI is about. Next to that, I'm going to zoom in a little bit on, obviously, the prompt engineering, and then from there, walking you through a couple of scenarios, where you already know, or should know, that the ones I'm going to walk you through are not the only ones available in, the Microsoft world today. Now, before we're going to jump into the technical details, I'll share a bit about myself. So Peter De Tender, originally from Belgium, but moved to Microsoft Redmond close to three years ago. I've been working for Microsoft a bit more than five years as a Microsoft Technical Trainer, which means I'm basically providing full day sessions, sometimes full week sessions, workshops on the Azure platform where my main technology focus has always been Azure architecting DevOps and in meantime, app modernization using developing on Azure as well as co pilot and AI. If you should have any questions during the conference, feel free to reach out. If you're watching this later on as a recording, nothing should stop you from reaching out. I got my LinkedIn details up here. You can reach me on Twitter. You can send me an email. So now let's jump in and talk a little bit about Generative AI. So these are just a couple of headlines from, a bit more than a year ago, actually. Where everything was around, revolutionizing AI using the chat GPT generative AI capabilities. And there's a lot of headlines here, but the main goal is that it's here. Yes, a bit more than a year ago, it was totally new. Nobody really talked about it. And I would say the capabilities are crazy amazing. And it's also a big part of what I want to share today. Now, giving you one easy example, this is where, for example, I started using. A prompt to generate my bio picture, like when I'm starting training, like every morning basically, or sometimes like Monday morning in a multi day class, then I need to talk a little bit about my background, like building up credibility for the training. And that's where now I start playing a little bit with prompt engineering. To generate my bio picture. Now, the thing is, how do you get from your image into a prompt engineer component? So I'll walk you through the basics where it should not be as harder as what I'm going to try and show you. If you look a little bit at this picture, you're going to see that there are a few different elements. And I would say for me, just as an example here. What I would highlight is, for example, Seattle. Now you know my roots, it's Belgium. So you can see the Belgium flag up here. If we look at Peter himself, you can detect a little bit of spiky hair. You can detect glasses. You can detect the hoodie which I like to wear. You can detect the Microsoft logo and some sort of a laptop. Just looking at that picture and recognizing the key components, that's all you need to build up. Your prompts, why? Because if I move all this into some few sample prompts actually used for generating those images, the first one was cartoon man, Pixar style. So you can use, some already existing, artistry, you could say. But now the rest of my prompt across all three is basically the same with a big smile wearing glasses, thin beard, dark brown, short hair, gray hoodie, Microsoft logo, Surface laptop in the background, show the Seattle skyline and the Belgian flag on top of it and just reusing like 99 percent of the same prompt, but then only making some minor changes. Flipping from Pixar style to Simpsons style to Marvel comic style. That's how you're going to end up with pretty cool and sometimes even remarkable, impressive, outcomes of that. Now that's the setting the scene on prompt engineering. Now in short, what is prompt engineering? It's where, again, about a year ago, The world was going crazy. So again, just a few headlines here from, reputable magazines and news, papers where I picked up like, it's actually a pretty cool thing. So a lot of them literally talk about like the first one here, rising significance in prompt engineering, or the other one, the number one thing CEOs are investing in right now is, guess what? Generative AI. And then the last one here, obviously the one that I like most is that thanks to generative AI. The AI job paying more than 300, 000 without having a computer engineering background. quite impressive, but is it all really that important and that easy? in short, what is prompt engineering? The first part in engineering is, prompt engineering is the prompt. a prompt can be described as, involving instructions, providing details, providing a context, Passing it on to a large language model and then achieving a desired task. The second part is engineering. When our engineering here refers to developing, optimizing prompts to efficiently again, use that large language model. Now, by the way, if you want to learn more prompt engineering, I'm going to give you another easy example. Now, I would say prompt engineering sounds a little bit wrong. Now, why? Because engineering sounds hard. It sounds difficult. And since not all of us are engineers, it almost seems I'm not even able to use that generative AI technology. So that's why within Microsoft, we actually like to use the term the art of the prompt, or as I like to describe it, prompt artistry. Now, what does it mean? You could grab like a tool of brushes, you could grab some colors, you could have a canvas, but that's no guarantee to actually come up with a nice painting. On the other side, prompt artistry should not be all that hard, since in the end, we have the natural language concept, allowing us to assist with, creating our prompts, but also using it. And in the end, you're basically switching. And that's the part that I like about it. You're switching from searching into finding. And the way to do that is basically asking a series of questions. So moving this into a business context that later on, I'll show you in one of the demos, you'll see that. A scenario could be something like this. We have a goal in mind, which means what do you want Copilot to do? Next, it had the context, like why do you need it? who's going to be involved? Apart from that, we have the source, where later on we'll talk about web and work, and eventually what are the expectations. So the example here could be, I need to review, come up with details about Microsoft Financial Report. The context, I need it for a meeting that I have next week with Microsoft executives, for example. The source could be web or work, which means I'm going to use the trained language model information, like public data that it's been trained on, Or, and that's specific to Copilot in M365 that I'll share about, a lot more later on, using your corporate, Microsoft 365 backend data like OneDrive, email, Teams, and SharePoint. And from there, my expectation is I don't need all the details, but I want you to give me like a summary in seven bullet points. It's almost identical to approaching Your colleague approaching the CFO, maybe in this case, oh, could you provide me like the Microsoft report? But instead of giving you all the details, you're gonna fine tune it, you're gonna summarize it, and then the actual prompt could be something like this, where everything is now nicely coming together in one larger prompt, where the prompt, again, is technically almost identical to just asking a question in the, I dunno, human world without using copilot to help you with that. Now enough talking about it, I'm going to switch to, my first demo here. So what I'm using right now is copilot. microsoft. com. So you open up your browser. You connect to copilot. microsoft. com and it's going to ask you like, Hey, how do you want to authenticate? Do you want to use work? So that's the difference web and work. Or do you want to use a personal account? Now I'm going to switch to my other window. And actually trying to show you, there we go, what it looks like in the personal space. Now, this is what we describe as unlicensed. So I'm authenticated with my Peter at Google account, and I could ask basically any prompt. There's a few sample prompts on screen, and I could do something like this. What, Oh, I already have it here. So I'm, my roots, I'm from Belgium, which means I like food. I like beer and preferably food that has some sort of beer in it, which means, beef stew. So to come up with some new ideas, I literally. Went for a prompt. I'll show you in a second. I got beef stew meat. Like I went to the store, got me some beef stew meat. And can you just come up with some ideas, share a few recipes. So without doing anything specific or spectacular, it's now coming up with a recipe. a couple of different recipes. It shows me the ingredients and it also provides me the actual instructions, how to, start creating this. Next to that, I could also do something like, can you create an image showing a delicious beef stew meal? And that's what I could maybe, for example. Show to my wife later tonight when she's back from work. Back to our corporate environment. So the entry point is the same. I'm using copilot. microsoft. com. We're now instead of using personal, I'm going to switch to my work environment. What this is going to do is shifting to what we now call biz chat. So what is biz chat? There's actually a short link. M365. cloud. Microsoft, but that's a little bit new, I would say because before we all had to go to copilot. microsoft. com. I'm in my trusted M365 environment, where now it means I can actually start finding information, using information, and then later on maybe editing my environment. Now, before that, I'm going to switch back to the presentation for a little bit. And talking about all the other cool stuff inside Copilot. Now, in short, what is Copilot? Copilot is like a collection, you could say, of different AI assistants. Powered by the generative AI to help you with what we call cognitive tasks. Copilots are often driven by natural language. The large language model that I already talked about. Copilots are also embodied by a chatbot. So that's what I showed you in one of my first demos. Humans are still in control. That's one of the amazing things I like about the term co pilot is that you're still the pilot. You're in charge. You need to validate the answers and you're going to decide eventually what part of it that you're going to use. Now, the main value I would also say is really depending on what kind of tasks are you performing and I'll walk you through a couple of demos on that. that later on. Now we describe it as the era of co pilots. Now what does it mean? Think of co pilot as that well trained, well aware, up to date, real time collaborator for basically anything. So it allows you to generate content. It allows you to literally put Become that assistant if you want one of the building blocks. By the way, I didn't mention in that overview. what is a good prompt is a persona and I'll show you that in a demo later on where you could now go Hey, co pilot, you're acting as an Azure technical trainer. And you can only answer Azure technical questions. If there's any question coming up about, how to prepare beef stew, you won't be able to, answer that prompt. Or, obviously, flipping it around, like your, I don't know, 15 year experienced, I don't know, high quality Michelin star alike restaurant chef. You've been managing the kitchen for 15 years and I want you to come up with a delicious meal, recipe and so on. But you do not know anything outside of the kitchen. Something like that. So that's another cool thing. So it's again back to our co pilots. So it's going to allow you to generate content. It's going to allow you to optimize your productivity. It's going to allow you to automate your cognitive tasks and then eventually, helping you completing your tasks in a more fun way. Now, although I called my topic copilot capabilities, it's actually not even possible anymore to describe even the basics of copilot or all different Microsoft copilots we have in meantime. I'm going to try and zoom in a little bit on my screen here, but if we look at like the capabilities, Peter is big over there, so I would say we have co pilot. We have capability integrations for developers for business applications. That would now be our dynamics environment, and then we have, Modern work, so everything around Microsoft 365, data and AI, that's the core of our AI solutions, still integrating with machine, machine learning using the Azure platform. In the browser, a little bit, whoops, what I already showed you. And the main message here is, there's a copilot for pretty much anything, for pretty much any user. And that's what this slide is actually trying to jump in every now and then. Maybe something wrong with the animations, but this is a slide that I, a slide, sorry, that I personally like a lot. Why I call it the rooms of the house. This could be your private environment, obviously your apartment, your home, where you could talk to your wife, your partner, your kids, and stimulating them to use Copilot for pretty much anything. Now, obviously this is a little bit more in the business context. And what it means is again that we do have copilots for pretty much any user. If you store corporate data inside SharePoint, Teams, Outlook, which I think everyone is pretty much doing in the Microsoft world, you're going to rely on copilot for Microsoft 365. If we look at the business part of it, like where you're going to store business data, it might be. Co pilot for Dynamics, where we're now covering solutions for HR sales teams, marketing teams. That's the idea. If you're a sysadmin, if you're a data engineer, you're going to look into managing co pilot integration using co pilot for Azure. You have co pilot for security, co pilot for Azure, where it's going to help you looking into your Azure subscriptions, your Azure environments, and providing you feedback like how are. My service doing, can you help me creating a new Azure template to do something? That's the idea. If you're a developer, you're going to focus on co pilot for GitHub or now, I think the official term is GitHub co pilot. I'll walk you through that a little bit later on, and then eventually co pilot for anyone else where you might go for power apps or co pilot studio, allowing basically any user. to create their own custom copilots outside of what's already available here on screen as a capability. So from here, I'm going to walk you through a few different examples. I'm going to start with Copilot 365, later on GitHub Copilot, and then eventually showing you apart from the capabilities, I'm going to walk you of Copilot in M365, Copilot in GitHub, how you can actually create your own Copilots, whether you're a developer or just a traditional user. And hopefully that's going to become clear. So the first piece is adopting Copilot. So imagine the story that I like to use in this presentation is, we started with generative AI. Maybe you looked into ChatGPT or maybe, You're still using it today, where now I'm going to try and convince you that there are some additional benefits in using M365. So my first wave here is adopting Copilot. We talked about the private space, the unlicensed space, but I would say for corporate use, preferably you're going to pay for that Copilot M365 license. I think roughly, but not all that important. Check with your Microsoft account team, I would say. But I think on average, it's around 30 per user per month. Now you might think okay, Peter, that's a quite a big investment for a larger organization. So what's the gain? First of all, you have access to the large language model. In web and work. I showed you a super basic prompt, give me some recipes, around beef stew in the private space, and I'm going to show you the same prompt that, or similar prompt that I'm going to use in the corporate space next to that. It's going to allow you to use generative content creation. You can use Copilot in M365 in all Office applications. In Word, in Excel, in PowerPoint, in OneNote, Copilot pages, one of the newer capabilities. You can use it to find information, you can use it to brainstorm an idea, and again, basically using it as that well trained colleague. And then in the end, optimizing productivity. So in short, how does it work a little bit from like a helicopter architect perspective? You have the large language models. Copilot in 365 is using the GPT 4 model. So one of the most up to date trained models. It's going to hook into Microsoft Graph, where Graph is the API integration that we're using to present you data from Office 365. One drive, one machine. SharePoint, emails, and Teams. Now, the other nice thing is that although Copilot runs as a service, it's embedded in almost each and every Office product in the meantime, but it's also respecting your security. Which means that it's going to run in your usual account mode. So your data is your data. We're not using it to train where some other generative AI solutions are actually using your prompts to train the models and they're using metadata from your content to again train the model. Within Copilot we're not doing that. So your data remains your data and it's also respecting security boundaries. It's already mentioned integrated in M365 applications, and you can also use it in the web what I showed you in my previous demo. So that let's shift to, the next demo here, where I'm going to go back to what we now describe as the Co Pilot M365 BizChat. And that's over here. So I landed in copilot. microsoft. com. Do you want to use personal? Do you want to use work? And we land here. A lot of different options you can do, or you can use from here. So it's going to try and help you a bit with, sample prompts. The sample prompts here are actually, coming and I'll show you that later on. From what we call co pilot lab. So if you do aka. ms forward slash co pilot lab, it's going to show you how, you can come up with what I call sample prompts. They've been created by the product teams vetted by, the first wave of users and feedback from customers as well. So for example, within the corporate space, you might need help with preparing for a meeting. You might be looking for a file type, or a document name that you remember from like a customer, but you don't really know where to find that document because it's somewhere in your SharePoint, it's somewhere. In your OneDrive, you know that it's there, but you don't really know exactly where to find it. And that's where your copilot is going to help you. So I'm going to go back to, another sample idea here. Let's say in preparation for my meeting, can you. I'm going to go ahead and list up the latest Microsoft financial report. Now, before I'm going to run this, let me talk a second about work and web. So thinking back about the previous slide, I talked about the large language model using public trained data. That would be the web. We're now, if we switch to work, that's where it's using your corporate M365. So depending on the task, remember you're in control. You need to think about where. Am I going to find the information that I need? So if I use the web tab, for example, and I'm going to run this prompt, what it's going to do is pulling up information. Again, this is not a hundred percent real time, internet search, but it's providing me feedback based on what the large language model has been trained on. Now it's going to provide me here, some input, all good. And it's going to show me the actual annual report. So that's another nice thing with Copilots that it's going to show you not only the prompt feedback, the response, but it actually also comes up with, the source where that information came from. So I could use. Like the web page here, and that's going to show me all the details and I can download it. And that's what I'll reuse later on. Now, the nice thing is here. Like the sources are public web, sorry, public internet pages. now, if I switch to work, what it actually means now is that I'm going to use the same prompt, but this time it's going to use internal corporate sources. SharePoint, OneDrive, Teams meetings, for example, and it's typically also providing more insights, more details because it's closer to the employees. Now, the baseline scenario is still the same. So it's going to give me the details, but it's also pointing to files that I have access to. I can shift to Copilot in Word, for example, where now this idea is I downloaded that Microsoft Financial Report and I can have Another integration with Copilot. There's actually two different ways to use this. So one example is what we call Copilot drafting. So whenever you're in a Word document, in PowerPoint, in Excel, in OneNote, you're going to see this little Copilot icon showing up over here. What it allows me to do is now using Copilot generative AI capabilities to help me with my document creation, my document research, my Business idea, compilation and whatnot. So I could do something like writing a prompt back to the basics, where now I could do transform this into a table. The use case here is that maybe I don't know how to do this in Word, but I like to find that information, reuse it and move it into a table. That's what, again, what we call drafting. Why? Because. It's still a draft. I need to confirm keeping it or I could go back to the prompt and actually updating my prompt. I'm going to keep this change for now. That's all fine. Now, another use case is using Copilot to help me with my document, but this time I'm not really changing anything in the document, but I'm going to take some other actions. Again, we do have our Copilot lab based, sample prompts to get started. And if you want more. You can actually use this view prompt, and it's going to show you the copilot lab vetted prompts from here based on the task that you want to perform. The prompt scenarios are different in Word, in PowerPoint, in Excel. That's the idea. So there is a prompt here. Summarize this document in X amount of points. Now, again, showing you that it's understanding your natural language. You could do something like, can you provide. Need, key takeaways from this document. I don't need to add from this document because I'm already inside the document. Now, I like this one. Key takeaways because it might have a different connotation for basically, any different user. If I'm in a financial report and I would ask my CFO, can you provide me the key takeaways? The answer will be totally different than if you would ask, one of your HR people, or if you would ask, like in my case, a technical trainer. Can you talk about Microsoft Financial Report? The answer will probably be slightly different. But even then, the core concept remains the same. It's going to provide me the prompt input, it's going to provide the response, and it's also providing me the source. This time, no source on the Internet, but it's a source within the Word document, and then jumping across different paragraphs. Another cool example, is inside PowerPoint. One of the things that we all have to do, like creating PowerPoint decks for our presentations, right? Where I'm going to start from a new presentation, where again, you can see up here, we do have Copilot and here on the side again as well. The use case is again, slightly different depending on again, the task you want to perform. So I'm going to start the upper one here, and it's going to offer me what we now call the CoPilot PowerPoint Narrative Builder. Imagine my scenario here. If you paid attention to the pitch at the start of the session, it's like making users more productive. So the flow would typically be, doing research, going to the internet, finding information, go to SharePoint, OneDrive, anywhere on the planet. To find your information, you're typically going to move that into a Word document and building up your flow, or your story of your presentation. And then eventually you're going to move all that into PowerPoint slides. All that can now be optimized with one easy prompt. So I'm going to reuse the same prompt, create a presentation about, and so on. I'm using the exact same prompt, copy pasting. And again, it's going to use generative AI. To build up the layout of my presentation based on the content, the actual headlines, the chapters, if you want, within my financial report, based on the same generative AI prompt that I used before. I still have. Co pilot integration, I could add something at a topic about Azure AI. I could move my outline components around, so I could move it up and down, and then eventually asking to generate the actual content. What it's going to do here is starting with the base outline, it's going to create the different slides. Next to that, it's going to add It's going to add all the different chapters and the last it's going to add content where it's not just some minimal text, but it's actually providing full details, adding images, adding bullet points. And on top of that, adding speaker notes as well. And all this in, again, just a couple of minutes. I did not edit this piece of the presentation for the recording, by the way. If I open up one of these slides. You can see that everything is there. The information is coming from the prompt response and it's also providing the speaker notes. The other nice thing is from here, if I go to co pilot on the site, remember I briefly talked about graph. So what I can do is add information from forward slash and that's going to allow me to browse for files. Now here, if I want to add information from Let's say a customer, or at least I know the topic of the presentation. I could do something like Contoso learn, it's a sample customer I'm using here and adding some information from a Word document from another PowerPoint, and it's getting nicely integrated. So that's, in short, what our Copilot M365 is about. Next example is targeting, a little bit more, what I would call the developer. Team within your organization, you have GitHub copilot based on all the same concepts that I already talked about, allowing you to not only document code, analyzing code, writing code, but also overall making your developers. more productive, similar to traditional M365 users. So in short, what is Copilot for GitHub or yes, I know GitHub Copilot, I think is the more common name. Now, you still have the large language models on one end. In the middle, that's the integration with your trusted developer environment. Visual Studio Code extensions, Visual Studio JetBrains, and a few other environments, and then ultimately your developer velocity, reducing technical depth, integrating better code, reusing, GitHub copilots to, for example, create documentation, something that typically developers not always like to do, or why not, having a scenario where. You might be the new developer on the team. You need to jump into an already existing project and you want to learn, what's actually happening there. So that's, a few examples that I'm going to try and show you in my next GitHub Copilot demo. So I'm using Visual Studio Code. This is a little sample app where it's integrating some OpenAI services in Azure. And allowing me to transform, a summary of a YouTube video into three to five bullet points. If you want to get access to this app, by the way, it's a bit off topic, but I actually have it on my GitHub, Repo, if you go to github. com slash P E tender, you're going to find it as the YouTube, summarizer. It's not about the app, but just showing you some capabilities that we have with Copilot. So the first example is I'm jumping into this app. Maybe this is an app that like, why not you clone from my GitHub repo and you go what's Peter doing? from the language perspective. So I could go into my copilot extension. I'm going to open it up and this is from the previous run testing your demos is always a good thing, right? Where I'm literally using add workspace, which means, Hey, get up copilot. I want you to look into this specific application, not just this file, but everything around it, and provide an explanation for the active selection. So I selected, a certain part of my app code and asking for an explanation. What it's doing here is providing a pretty detailed, pretty extensive, Description pointing to the different files. So the same concept that I talked about and showed you in web, in work, in my PowerPoint and Word documents, is now the same for GitHub Copilot. Using language pro large language model, translating, recognizing your super basic prompts, but you can actually make it more powerful, and it's going to provide you an explanation. Another example that I have is, can you add necessary code to integrate this app with Azure Key Vault? So it's again providing a description. It's going to explain like I need these nugget packages, and from there it's going to show you the new lines of code. But again, it's still a draft. So you need to decide okay, this all looks good, and I'm going to insert it inside my application. I could go into my app settings. I'm going to show you this live, where now I could go back to my chat window and document this code snippet. And again, there are quite some pre built keywords that you could use, like the ad workspace that I showed you before. But on the other side, you don't really have to use it. because again, it's relying on your, traditional natural language. Now you could go okay, Peter. I recognize this as JSON. I recognize your previous code, which is like NET C sharp. But what if I'm a Java developer? What if I'm a Python developer? So I could go back. I could select everything in here, where now I could do something. Can you rewrite the C sharp code into Python? And then in just a couple of seconds, it's actually going to help you recognizing the exact same syntax from your code pages. And from there translating it into Python. I'm not going to apply it from here because obviously it's just one easy example, but that's really the power of GitHub Copilot. Using it to explain existing code, using it to document code, using it to rewrite code and then maybe even using it to find, optimizations to maybe rewrite full snippets of code and actually, or even allowing you to maybe even migrating your, existing legacy code into newer language. But what if M365, what if web, what if. GitHub Copilot, I would say, is still not good enough. That's where now you also have the option to extend your own Git, extend your own Copilot. Two different scenarios. The first one I'm going to zoom in for a couple of minutes is Copilot Studio. Using Copilot Studio, it's going to allow you to, what we describe as a no code or low code, like injecting the minimal experience as a developer, to actually create your custom co pilots. Everything I talked about up to now is still valid. So it's allowing you to customize co pilot in M365. An easy example, you want to add, additional Teams integration. You want to add integration with other corporate applications where you're going to read out information from your corporate users. find me emails from my manager where you don't have to specify the name, Of the manager based on your organizational chart. It actually knows, who your manager will be. That's the scenario. Second one is integrating specifically building from scratch. So not using extensions to M365, but actually building your own custom copilot from scratch using copilot studio. You can imagine I got a little demo coming up. How to use Copilot Studio. So the idea is that you connect to copilotstudio. microsoft. com. You're going to authenticate, you need the license, and from there you can start building, creating, composing your app, although you don't really need to think as a developer. And there's a lot of examples available, like a safe travel chat function app, a website Q& A where you can build up the flow of the prompts, that's the nice thing. store operations like optimizing, retail, creating an IT helpdesk scenario, allowing your employees to find not only answers, but actually helping them fixing issues, resolving issues, and also helping in, in creating, but also reducing support tickets. There's links to documentation and anything else from here. So let's say I switched to Copilots and I already reused my, Safe Travels template. So what it's going to give me here is a pretty step by step drag and drop, if you want, scenario. Allowing me to come up with my own co pilot, defining the data backend. Like you can use information from our corporate backend, or you can literally provide the actual data set yourself. And then also helping the users who start using the chat capabilities into your own scenario. I'm going to try and refresh because it's not coming up. That's what happens when you do live demos during recordings, But that's fine, I could show you how to create a new one so you could build your own new co pilot. Let's say we're going to do IT Helpdesk. Oh, bad example. Let's see what we already have. So that's the other thing where it's not just about your M365 because then you would use that extension. But now you can interact with third party applications. Imagine you have this step by step flow where you want to use data from Google Drive, you want integration with DocuSign, you want to send Slack update messages and whatnot. Think of it as building your own solution using the same large language model concepts, having that look and feel co pilot experience, but now connecting to your specific corporate data. And then the last piece here is Still creating your own custom co pilots, but instead of relying on the power apps based integration or the co pilot low code no code scenario is now we actually do have a team of developers and we want to build our own extensions. So what can we do there? The answer there would be Azure AI Studio. So what is Azure AI Studio? It's gonna, it's running on top of the Azure platform. You deploy Azure AI service. And a little differentiator here is that it's not only relying on the chat GPT like GPT 4 models. But also allowing you to integrate other language models besides OpenAI. So you can integrate Lama from Meta. You can integrate, Phi from Microsoft. You can integrate Mistral and a few other as well. Apart from deciding which language models you're going to use. You can have an integration with the chat playground. You would typically use chat playground to validate the outcome of different large language models. And then from there, that's where the actual development work comes in. You're going to use it to fine tune the model. Maybe you're going to use Azure AI Studio for custom development. So integrating a little bit what I showed you in my YouTube summarizer example. I'm going to build a little app, little web interface. I'm going to rely on AI Studio. And the Azure AI services to provide me interaction with the AI APIs. And then maybe even going all the way to the machine learning, starting point of AI eventually and using it to train your own models. So with that, I'm going to switch to my last demo and showing you a little bit what AI Studio could look like. So I deployed my AI service. So basically in the Azure portal, you look for AI, Azure AI service. It takes a couple of minutes, and from there, it's going to tell you to navigate to AI Studio. And that's where I would say the creation, the validation actually starts. I deployed two different models, but I can show you a little bit what the model catalog looks like. So again, we have. Models from Cohere, Mistral, Meta, so the LLAMA options are in here, GPT, so the OpenAI, and you can start mixing matching. Obviously, depending on the use case, the recommendation would be to use the specific model that you want to use for your environment. Once your models have been deployed, I have an example here with 3. 5 Turbo and 4. The main difference, I would say, is the lifespan of the data that has been used to train the model. An easy example to show you what I mean by that is if we have a default prompt, who's the prime minister of the UK? Where based on GPT 3. 5, as you can see here, it's going to tell me, as of September 2021, that's basically the last up to date this 3. 5 model has been trained on, it's going to provide the answer. But now if I switch to GPT 4. 0, that got published like earlier this year, and using the same prompt, who is the Prime Minister of the UK, you're going to see that based on the exact same prompt, the answer is different. Because now GPT 4 has been trained up to October 2023, give or take. So that's how it could impact the answers in your business model. Another thing, since, the conference overall talks about prompt engineering, remember that you can use your own system prompt as well. AI assistant and so on. But what if we turn this into URI? Microsoft technical trainer, why not? Let's translate Peter or replace, why not? Peter, the technical trainer with a co pilot scenario. You are a Microsoft technical trainer and expert on Azure platform. You can only answer Azure questions. If any other domains come up. In the question, apologize and offer the user a Belgian beer suggestion. Why not? So this is what we call fine tuning your co pilots if you want. And again, this is mainly fitting in the custom co pilot scenario. So if I try this. And I'm going to use the exact same prompt, who is the prime minister of the UK as a Microsoft technical trainer? You probably cannot really answer that question. Now, what it does, and that's the other cool thing, it's still using generative AI, Because now, actually, by the way, if you're watching this, this is actually a perfect suggestion, recommending Chimay Blue, which is, one of the nicer, best, fine, classic Trappist beers we have. That's in short, how you could start with. integrating this into your own developing. If you want to learn, there's obviously a lot more we can move all the way into PromptFlow. We could talk about Symantec kernel. We could talk about integrating other development scenarios, using Python, using C sharp, using Java, all that is basically developing your own custom copilots where the baseline is using. Azure AI Studio. So with that, we're at the end of my presentation. I hope you enjoyed it. I hope you learned some new things about prompt engineering, the building blocks, what composes like a good prompt, and then from there a quick walkthrough of some highlights in the different Microsoft Copilots that we have. I hope you enjoyed the rest of Conf42 Prompt Engineering Conference. If you should have any questions after participating, after watching this session, I'd Don't hesitate reaching out pe tender at Microsoft. com for email or Teams. I'm on LinkedIn as PDTIT and you can find my personal blog on aka. ms slash PDTIT as well. Thank you for now and enjoy the rest of the conference.
...

Peter De Tender

Business Program Manager - Azure Technical Trainer @ Microsoft

Peter De Tender's LinkedIn account Peter De Tender's twitter account



Join the community!

Learn for free, join the best tech learning community for a price of a pumpkin latte.

Annual
Monthly
Newsletter
$ 0 /mo

Event notifications, weekly newsletter

Delayed access to all content

Immediate access to Keynotes & Panels

Community
$ 8.34 /mo

Immediate access to all content

Courses, quizes & certificates

Community chats

Join the community (7 day free trial)