People

DataHunt is a proactive organization

Interview | Jisu Yu, AI Engineer

2022
.
12
.
23
by
HR Team, Datahunt
Interview | Jisu Yu, AI Engineer

Datahunt utilizes AI across the machine learning lifecycle. As a small startup, we've been able to do this because we have a talented team of AI engineers who have been working hard on our technology, reducing the time and cost of running business projects, making them more efficient and more accurate. It's December, the beginning of winter, and the snow is falling, so we're excited to introduce you to Jisu Yu, an AI engineer who is having a busy holiday season.

 

AI Engineer, we want to know about you.

 

Q Hello. It's a pleasure to meet you. Can you tell us a little about yourself?

 

A. Hello. I'm Jisu Yu, an AI engineer at Datahunt. There are two main areas of research in our company, natural language processing and computer vision, and I am working on computer vision, which mainly deals with image and video data.

 

 

Q Did you work as an AI engineer before joining Datahunt?

 

A. Yes, I was originally working as an AI researcher. I joined Datahunt in February of this year.

 

During my graduate school, I was doing research related to natural language processing and text data, but somehow, my first job was computer vision and image data. It was great to learn new research areas and grow my career, but at the same time,I thought it was a bit sad to abandon the natural language processing that I had studied. That's when I found out about DataHunt. Since DataHunt is a company that processes various data without being limited to any field, I decided to join because I thought that I could continue to do NLP in addition to computer vision.

 

 

A day in the life of an AI engineer at DataHunt

 

Q. Were you worried about moving to a startup? What do you think is the appeal of a startup?

 

A. I don't know if I'm lucky or not, but I've never had a problem with research, and it's attractive to me that I can take the initiative to do the research I want and see the results immediately. If you're someone who feels satisfied with this, I think a startup will be a good fit.

 

Q. I'd like to know what you're working on these days. Can you give us a glimpse into the process or how the team of AI engineers at DataHunt works on a project?

 

A. Recently, I've been working on AI that automatically masks information that can identify specific individuals, such as faces, license plates, and the back of social security numbers, because countries are required to remove them when processing data.

 

At first, the requested data was images, so we developed an object detection model that could detect and mask faces and license plates in images, but later, we needed a de-identification model for video data, so we researched object tracking. Of course, you can simply break the video into frames and make separate inferences for each image, but in object tracking, the information of the previous frame and the next frame is connected, so even if the model does not detect an object in a certain frame, it can supplement the result based on the previous information. The model we developed is a bidirectional object tacking model that references not only the previous frame information but also the information of the next n frames. When comparing the detection performance of image-by-image inference, one-way object tracking, and bidirectional object tracking, the performance of the bidirectional object tracking model we developed was the best.

Our process differs slightly from case to case, but basically, we first make a basic plan based on the kind of technology and data required for the project and its purpose. Then, we search for data and models that are suitable for the purpose and conduct primary experiments. Based on the results of the baseline, we determine the feasibility and then create our own model while exchanging ideas and opinions with team members for full-scale development. It's a cycle of exploration, communication, research, and evaluation.

 

데이터헌트 AI 엔지니어 유지수 인터뷰

Q. What's one of the most interesting challenges or projects you've worked on as an AI engineer recently?

 

A. Recently, I mentioned that I was working on object tracking for de-identification, and in some cases, the tracking was not smooth because they were identified as similar objects even though they were different people.Using simple image similarity comparisons, it was not easy to distinguish them because the detailed characteristics of the faces were not reflected, so we tried to apply face-recognition to distinguish them, and we got much better results than checking the basic image similarity.

 

In addition to that, there's a baseline that the model gives you, a threshold that says, "This is a similar person," and that might be optimal, but it might not be optimal for our study, so we experimented with different parameters to see which ones were optimal for our data. In addition, when an object moves quickly in a video, even if it's captured as an image, it's often blurred, and we call it "blurred." We also experimented with deblurring the image to correct for the blur and comparing the image similarity, and we found that we got a more accurate result than comparing the similarity without deblurring.

Asyou go through research like this, the performance of the model itself is important, but there may be other ideas or techniques that can complement it.I'm always trying to improve our technology by sharing thoughts with my teammates and applying new ideas, and it's a great feeling of accomplishment.

 

 

Q. With only a month left until 2023, what does the next year hold for Datahunt team of AI engineers?

 

A. Right now, all of our AI engineers are working on different projects, but next year, all of our researchers will be working on one project to prepare our model service.

In order to prepare for this goal, many employees and researchers have been working on AI-related ideation, and we are in the process of making a plan by reviewing various aspects such as marketability, feasibility, and technology of the ideas generated in the process. If the plan is well thought out, I think we will do well because I believe in our researchers' abilities.

 

 

The future and direction of AI from an AI engineer's perspective

 

Q. A team of trust, that's great. You've had a lot going on at DataHunt lately, including the move to a new office, and you're coming off a busy holiday season, what's the mood of the team of AI engineers like?

 

A. One of the things I noticed when I first joined DataHunt was that the team itself was very cohesive, and I got the impression that everyone took responsibility for their own work and did it well.

 

I think when I was in grad school and in other organizations, as you have more people, there's always one person who's struggling or missing, but so far I think we're all in sync, and we're all in good spirits, so I think we're going to be able to get through the tough end of the year because we're all in good spirits.

The office space itself is bigger than before, and we have a conference room. Oh, and we also have a personal space where I can work alone when I want to focus on my work. I'm much more productive when I'm in my own space on days when I'm feeling particularly distracted. I can't wait to show it off sometime.

 

데이터헌트 AI 엔지니어 유지수 인터뷰

 

Q. With the vision of AI, the demand for AI engineers is expected to increase.What are some of the career value and experiential benefits of working as an AI engineer at Datahunt?

 

A. One of the things I realized when I started working at Datahunt, and this may seem obvious, is that all the departments involved in a project, including researchers, hold meetings together.

 

In my previous job, I also did AI research, but even if I was the lead on a project, I didn't involve researchers in every meeting. They would ask us for consultation or advice on technology, but that was about it. Since we were collaborating with external organizations, most of the time, people who weren't involved in AI technology would hold meetings first, and then communicate their conclusions to us.

But with DataHunt, we start the meeting with the CEO, the planners, the operations team, and the AI engineers organizational chart, so we can be more honest about our position in the project process, and we can give technical advice to non-developers and discuss scheduling, etc.

Asa researcher, I can fully understand and participate in the flow of the project I'm working on, rather than just doing research. I think this is only possible at DataHunt, which emphasizes communication and collaboration.

 

데이터헌트 AI 엔지니어 유지수 인터뷰

Q. In the future, DataHunt will also be hiring additional AI engineers. What kind of person do you think is a good fit for the Datahunt AI team?

 

A. Someone who has an understanding of their field, who can think, worry, and communicate continuously for their own research. Someone who thinks that the work they are doing is something that they should take the initiative to lead and be responsible for, and that they can develop themselves through it, rather than just thinking that it's the company's work, I think that kind of person fits in with our current team members. If we have someone like that, I think we will have a good synergy with each other and be able to work on research more actively and interestingly.

 

Q. That's great to hear. Let's talk about something a little different. Recently, AI technology has taken a different direction and is gaining a lot of traction with the general public. Are there any technologies that you think have a vision for the future, or are there any AI technologies that you think will be used the most in general?

 

A. If you look at ChatGPT, Dalle 2, or NovelAI, which have been in the news recently, I think generative models are hot. I think this momentum will be maintained for awhile, and I think there will be more demand for multimodal model research that combines text and image data. Dalle 2 and NovelAI also fall into the category of multimodal models.

 

Q. As anAI engineer, what has been your most rewarding moment?

 

A. I think the most rewarding moments are when my models are used in the field or when other people are satisfied with the results.

 

At my previous company, I developed a model to automatically detect dangerous items(smartphones, USBs, storage devices, etc.) in bags for corporate security. You know how at airports we put suitcases through a machine to check for prohibited items on airplanes? They do it at the entrance of a company, too, if it's a large corporation or something that requires security.

At the time, we weren't doing very well with USB detection compared to other categories, and from what I've heard, other companies weren't either, so we went through a lot of different models and approaches to try to solve the problem, and we were able to improve the performance along the way, and I remember when we demoed it to our actual customers, they were amazed at the results.

It reminds me of when we were working on recommendation systems at DataHunt. For example, when you're trying to recommend an activity to a user, you might use a user's characteristics. If height is more important than gender, it should be weighted more heavily to give it more influence on the results. To get the desired recommendation results, we need to assign importance to each data value. The client can set the importance, but we wondered if there was a way to automatically calculate the weights as part of the service. At first, some people thought it would be too difficult, but after much thought, we found away to make this calculation possible, and we were able to produce a convincing result. I remember the CEO sitting next to me in a meeting and saying in a quiet voice, "Good job." I think it was the first time I've ever heard him say that.

 

Q. Speaking of "convincing AI," there's been some research that suggests that companies considering using AI in their business would prefer"explainable AI," even if it means less performance. What are your thoughts on this?

 

A. There is a lot of research being done on "explainable AI". It's called XAI, and I think it's very important for users to be able to understand the results delivered by the AI, and to understand the process of why the results come out the way they do, so that we can improve the performance based on that process and give users confidence in the performance of the AI. We are very interested in this area and use it as a reference point for improving our services.

 

Q. Thank you so much for taking the time to speak with us today. In closing, do you have any words of wisdom for all of us at Datahunt who may be struggling through the holidays?

 

A. I know that everyone on the team is doing their part and being responsible. I know that when other team members are struggling, they're willing to step up and help, and I think that's what's great about our company. We're all awesome. I hope you all have a healthy holiday season.

Talk to Expert